2024-07-04T01:26:11.623062860Z 2024-07-04T01:26:12.914323844Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-07-04T01:26:14.448838158Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-07-04T01:26:18.994791726Z ____________ _____________ 2024-07-04T01:26:18.994813428Z ____ |__( )_________ __/__ /________ __ 2024-07-04T01:26:18.994816887Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-07-04T01:26:18.994820065Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-07-04T01:26:18.994823292Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-07-04T01:26:18.994827146Z [2024-07-04T01:26:18.994+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-07-04T01:26:19.000092038Z [2024-07-04T01:26:18.994+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-07-04T01:26:20.022347874Z [2024-07-04T01:26:20.020+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-07-04T01:26:20.064714753Z [2024-07-04T01:26:20.036+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 15 2024-07-04T01:26:20.065834427Z [2024-07-04T01:26:20.065+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T01:26:20.134595968Z [2024-07-04T01:26:20.101+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-07-04T01:26:20.153542895Z [2024-07-04T01:26:20.148+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-07-04T01:26:32.390915097Z [2024-07-04T01:26:32.390+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:26:32.474743660Z [2024-07-04T01:26:32.474+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:26:32.474757351Z 2024-07-04T01:26:32.475136615Z [2024-07-04T01:26:32.474+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:26:32.475760355Z [2024-07-04T01:26:32.475+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:26:32.475770260Z 2024-07-04T01:26:32.480098724Z [2024-07-04T01:26:32.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:26:32.480715208Z [2024-07-04T01:26:32.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:26:32.757833335Z [2024-07-04T01:26:32.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:24:00+00:00 exited with status queued for try_number 1 2024-07-04T01:26:32.771172301Z [2024-07-04T01:26:32.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bf60aaf-9e47-43ba-bd6a-58a5b808a8bd 2024-07-04T01:26:35.092530948Z [2024-07-04T01:26:35.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:26:35.092985776Z [2024-07-04T01:26:35.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:24:00+00:00, run_id=scheduled__2024-07-04T01:24:00+00:00, run_start_date=2024-07-04 01:26:32.415125+00:00, run_end_date=2024-07-04 01:26:35.092505+00:00, run_duration=2.67738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:24:00+00:00, data_interval_end=2024-07-04 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:26:35.104587654Z [2024-07-04T01:26:35.104+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:26:00+00:00, run_after=2024-07-04T01:28:00+00:00 2024-07-04T01:26:35.142474641Z [2024-07-04T01:26:35.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:24:00+00:00 exited with status success for try_number 1 2024-07-04T01:26:35.149351750Z [2024-07-04T01:26:35.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:24:00+00:00, map_index=-1, run_start_date=2024-07-04 01:26:33.708342+00:00, run_end_date=2024-07-04 01:26:34.149827+00:00, run_duration=0.441485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:26:32.477264+00:00, queued_by_job_id=2, pid=37 2024-07-04T01:28:00.730631326Z [2024-07-04T01:28:00.730+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:28:00.827084108Z [2024-07-04T01:28:00.824+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:28:00.827100392Z 2024-07-04T01:28:00.827213863Z [2024-07-04T01:28:00.827+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:28:00.827809467Z [2024-07-04T01:28:00.827+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:28:00.827819594Z 2024-07-04T01:28:00.833861560Z [2024-07-04T01:28:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:28:00.833980136Z [2024-07-04T01:28:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:28:00.975353734Z [2024-07-04T01:28:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:26:00+00:00 exited with status queued for try_number 1 2024-07-04T01:28:01.011054959Z [2024-07-04T01:28:01.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5bd2e38-125e-4b99-ba91-ca6878384c24 2024-07-04T01:28:03.811370567Z [2024-07-04T01:28:03.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:28:03.811807896Z [2024-07-04T01:28:03.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:26:00+00:00, run_id=scheduled__2024-07-04T01:26:00+00:00, run_start_date=2024-07-04 01:28:00.787000+00:00, run_end_date=2024-07-04 01:28:03.811308+00:00, run_duration=3.024308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:26:00+00:00, data_interval_end=2024-07-04 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:28:03.825406646Z [2024-07-04T01:28:03.825+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:28:00+00:00, run_after=2024-07-04T01:30:00+00:00 2024-07-04T01:28:03.884456075Z [2024-07-04T01:28:03.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:26:00+00:00 exited with status success for try_number 1 2024-07-04T01:28:03.903726991Z [2024-07-04T01:28:03.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:26:00+00:00, map_index=-1, run_start_date=2024-07-04 01:28:02.225710+00:00, run_end_date=2024-07-04 01:28:02.889380+00:00, run_duration=0.66367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:28:00.828147+00:00, queued_by_job_id=2, pid=74 2024-07-04T01:30:00.507811333Z [2024-07-04T01:30:00.506+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:30:00.600059311Z [2024-07-04T01:30:00.599+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:30:00.600069952Z 2024-07-04T01:30:00.600311415Z [2024-07-04T01:30:00.600+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:30:00.601397148Z [2024-07-04T01:30:00.601+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:30:00.601411652Z 2024-07-04T01:30:00.606301370Z [2024-07-04T01:30:00.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:30:00.606598489Z [2024-07-04T01:30:00.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:30:00.717591141Z [2024-07-04T01:30:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:28:00+00:00 exited with status queued for try_number 1 2024-07-04T01:30:00.733013146Z [2024-07-04T01:30:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb3366e4-e069-4b69-9f49-c371086205b7 2024-07-04T01:30:02.896633973Z [2024-07-04T01:30:02.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:30:02.897001476Z [2024-07-04T01:30:02.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:28:00+00:00, run_id=scheduled__2024-07-04T01:28:00+00:00, run_start_date=2024-07-04 01:30:00.532241+00:00, run_end_date=2024-07-04 01:30:02.896665+00:00, run_duration=2.364424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:28:00+00:00, data_interval_end=2024-07-04 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:30:02.906388509Z [2024-07-04T01:30:02.906+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:30:00+00:00, run_after=2024-07-04T01:32:00+00:00 2024-07-04T01:30:02.940553391Z [2024-07-04T01:30:02.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:28:00+00:00 exited with status success for try_number 1 2024-07-04T01:30:02.949424125Z [2024-07-04T01:30:02.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:28:00+00:00, map_index=-1, run_start_date=2024-07-04 01:30:01.584172+00:00, run_end_date=2024-07-04 01:30:02.078850+00:00, run_duration=0.494678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:30:00.602048+00:00, queued_by_job_id=2, pid=112 2024-07-04T01:31:20.783106997Z [2024-07-04T01:31:20.781+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T01:32:00.601700423Z [2024-07-04T01:32:00.601+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:32:00.675198780Z [2024-07-04T01:32:00.674+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:32:00.675219082Z 2024-07-04T01:32:00.675250227Z [2024-07-04T01:32:00.675+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:32:00.675807435Z [2024-07-04T01:32:00.675+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:32:00.675814637Z 2024-07-04T01:32:00.679711443Z [2024-07-04T01:32:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:32:00.680006263Z [2024-07-04T01:32:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:32:00.753108979Z [2024-07-04T01:32:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:32:00.764197841Z [2024-07-04T01:32:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02f9d597-297b-49a1-b6b2-4010189b8778 2024-07-04T01:32:02.561863810Z [2024-07-04T01:32:02.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:32:02.562212184Z [2024-07-04T01:32:02.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:30:00+00:00, run_id=scheduled__2024-07-04T01:30:00+00:00, run_start_date=2024-07-04 01:32:00.630087+00:00, run_end_date=2024-07-04 01:32:02.561869+00:00, run_duration=1.931782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:30:00+00:00, data_interval_end=2024-07-04 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:32:02.570578801Z [2024-07-04T01:32:02.570+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:32:00+00:00, run_after=2024-07-04T01:34:00+00:00 2024-07-04T01:32:02.603176093Z [2024-07-04T01:32:02.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status success for try_number 1 2024-07-04T01:32:02.611210965Z [2024-07-04T01:32:02.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=-1, run_start_date=2024-07-04 01:32:01.544941+00:00, run_end_date=2024-07-04 01:32:01.955871+00:00, run_duration=0.41093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:32:00.676101+00:00, queued_by_job_id=2, pid=149 2024-07-04T01:32:52.247970419Z [2024-07-04T01:32:52.247+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:32:52.303750912Z [2024-07-04T01:32:52.303+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:32:52.303860910Z 2024-07-04T01:32:52.303893663Z [2024-07-04T01:32:52.303+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:32:52.304408629Z [2024-07-04T01:32:52.304+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:32:52.304460531Z 2024-07-04T01:32:52.306813441Z [2024-07-04T01:32:52.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:32:52.306959964Z [2024-07-04T01:32:52.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:32:52.376462123Z [2024-07-04T01:32:52.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:31:00+00:00 exited with status queued for try_number 1 2024-07-04T01:32:52.383095459Z [2024-07-04T01:32:52.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2d88e0d-8a28-4b67-bf33-b42558795794 2024-07-04T01:32:54.011984834Z [2024-07-04T01:32:54.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:32:00+00:00, run_after=2024-07-04T01:33:00+00:00 2024-07-04T01:32:54.058191233Z [2024-07-04T01:32:54.057+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:32:54.058217676Z 2024-07-04T01:32:54.058758430Z [2024-07-04T01:32:54.058+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:32:54.059436457Z [2024-07-04T01:32:54.059+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:32:54.059452097Z 2024-07-04T01:32:54.061709953Z [2024-07-04T01:32:54.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:32:54.062126800Z [2024-07-04T01:32:54.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:32:54.109863114Z [2024-07-04T01:32:54.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:31:00+00:00 exited with status queued for try_number 1 2024-07-04T01:32:54.117368348Z [2024-07-04T01:32:54.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40c9cd13-5dc6-4c52-97aa-59174c6b4b4c 2024-07-04T01:32:57.458258707Z [2024-07-04T01:32:57.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:30:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:32:57.613021761Z [2024-07-04T01:32:57.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:32:57.613358688Z [2024-07-04T01:32:57.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:31:00+00:00, run_id=scheduled__2024-07-04T01:31:00+00:00, run_start_date=2024-07-04 01:32:52.265150+00:00, run_end_date=2024-07-04 01:32:57.612962+00:00, run_duration=5.347812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:31:00+00:00, data_interval_end=2024-07-04 01:32:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:32:57.634428784Z [2024-07-04T01:32:57.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:32:00+00:00, run_after=2024-07-04T01:33:00+00:00 2024-07-04T01:32:57.658284120Z [2024-07-04T01:32:57.658+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:32:57.658297302Z 2024-07-04T01:32:57.658485463Z [2024-07-04T01:32:57.658+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:32:57.659113737Z [2024-07-04T01:32:57.658+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:32:57.659132642Z 2024-07-04T01:32:57.663805550Z [2024-07-04T01:32:57.663+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:32:57.663965721Z [2024-07-04T01:32:57.663+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:32:57.718809669Z [2024-07-04T01:32:57.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status queued for try_number 1 2024-07-04T01:32:57.718993527Z [2024-07-04T01:32:57.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:31:00+00:00 exited with status success for try_number 1 2024-07-04T01:32:57.729208038Z [2024-07-04T01:32:57.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:31:00+00:00, map_index=-1, run_start_date=2024-07-04 01:32:54.696437+00:00, run_end_date=2024-07-04 01:32:56.919556+00:00, run_duration=2.223119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:32:52.304759+00:00, queued_by_job_id=2, pid=181 2024-07-04T01:32:57.732017811Z [2024-07-04T01:32:57.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7940f3be-7a25-4c2c-af92-339db2f840fb 2024-07-04T01:33:00.177573344Z [2024-07-04T01:33:00.177+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:33:00.219757948Z [2024-07-04T01:33:00.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:33:00+00:00, run_after=2024-07-04T01:34:00+00:00 2024-07-04T01:33:00.341835411Z [2024-07-04T01:33:00.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:33:00.343461873Z [2024-07-04T01:33:00.343+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:31:00+00:00, run_id=scheduled__2024-07-04T01:31:00+00:00, run_start_date=2024-07-04 01:32:54.025502+00:00, run_end_date=2024-07-04 01:33:00.342052+00:00, run_duration=6.31655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:31:00+00:00, data_interval_end=2024-07-04 01:32:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:33:00.383991802Z [2024-07-04T01:33:00.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:32:00+00:00, run_after=2024-07-04T01:33:00+00:00 2024-07-04T01:33:00.460183679Z [2024-07-04T01:33:00.459+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:33:00.460209485Z 2024-07-04T01:33:00.460228505Z 2024-07-04T01:33:00.460293853Z [2024-07-04T01:33:00.460+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:33:00.460433077Z [2024-07-04T01:33:00.460+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:33:00.461073106Z [2024-07-04T01:33:00.460+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:00.461082661Z 2024-07-04T01:33:00.461085849Z 2024-07-04T01:33:00.467738247Z [2024-07-04T01:33:00.467+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:33:00.468004597Z [2024-07-04T01:33:00.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:33:00.470088508Z [2024-07-04T01:33:00.468+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:33:00.471592235Z [2024-07-04T01:33:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:33:00.821656847Z [2024-07-04T01:33:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:00.821937564Z [2024-07-04T01:33:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:00.822101895Z [2024-07-04T01:33:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:31:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:00.844270179Z [2024-07-04T01:33:00.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:31:00+00:00, map_index=-1, run_start_date=2024-07-04 01:32:57.264814+00:00, run_end_date=2024-07-04 01:32:59.154757+00:00, run_duration=1.889943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:32:54.060077+00:00, queued_by_job_id=2, pid=201 2024-07-04T01:33:00.845280464Z [2024-07-04T01:33:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to 318b3efc-1878-4946-8dfe-0d1aa48ba392 2024-07-04T01:33:00.845636297Z [2024-07-04T01:33:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ac45091-743a-49a9-9d24-b6d4f56b4be5 2024-07-04T01:33:00.896230507Z [2024-07-04T01:33:00.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:33:00+00:00, run_after=2024-07-04T01:34:00+00:00 2024-07-04T01:33:02.083537872Z [2024-07-04T01:33:02.083+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:33:02.083553045Z 2024-07-04T01:33:02.083929832Z [2024-07-04T01:33:02.083+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:33:02.084540319Z [2024-07-04T01:33:02.084+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:02.084548695Z 2024-07-04T01:33:02.087479109Z [2024-07-04T01:33:02.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T01:33:02.087648327Z [2024-07-04T01:33:02.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:02.136586192Z [2024-07-04T01:33:02.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:02.138556917Z [2024-07-04T01:33:02.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:02.143466302Z [2024-07-04T01:33:02.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:25:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:00.246453+00:00, run_end_date=2024-07-04 01:33:01.024193+00:00, run_duration=0.77774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:32:57.661944+00:00, queued_by_job_id=2, pid=225 2024-07-04T01:33:02.145107521Z [2024-07-04T01:33:02.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7444eeb5-734d-48af-889d-4a84f216af2f 2024-07-04T01:33:05.255638531Z [2024-07-04T01:33:05.255+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:33:05.255656977Z 2024-07-04T01:33:05.255897472Z [2024-07-04T01:33:05.255+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:33:05.256843214Z [2024-07-04T01:33:05.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:05.256863323Z 2024-07-04T01:33:05.260493954Z [2024-07-04T01:33:05.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T01:33:05.260853630Z [2024-07-04T01:33:05.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:33:05.320688773Z [2024-07-04T01:33:05.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:05.320716852Z [2024-07-04T01:33:05.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:05.327685870Z [2024-07-04T01:33:05.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 832e7a8e-7d39-4a2f-82df-f176ca53a8d4 2024-07-04T01:33:05.327984415Z [2024-07-04T01:33:05.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T01:25:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:04.201018+00:00, run_end_date=2024-07-04 01:33:04.621818+00:00, run_duration=0.4208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:02.084867+00:00, queued_by_job_id=2, pid=287 2024-07-04T01:33:05.411629548Z [2024-07-04T01:33:05.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:33:05.411865216Z [2024-07-04T01:33:05.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:32:00+00:00, run_id=scheduled__2024-07-04T01:32:00+00:00, run_start_date=2024-07-04 01:33:00.258331+00:00, run_end_date=2024-07-04 01:33:05.411562+00:00, run_duration=5.153231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:32:00+00:00, data_interval_end=2024-07-04 01:33:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:33:05.423618781Z [2024-07-04T01:33:05.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:33:00+00:00, run_after=2024-07-04T01:34:00+00:00 2024-07-04T01:33:06.561508964Z [2024-07-04T01:33:06.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:33:06.561825165Z [2024-07-04T01:33:06.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:32:00+00:00, run_id=scheduled__2024-07-04T01:32:00+00:00, run_start_date=2024-07-04 01:33:00.258848+00:00, run_end_date=2024-07-04 01:33:06.561450+00:00, run_duration=6.302602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:32:00+00:00, data_interval_end=2024-07-04 01:33:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:33:06.577025980Z [2024-07-04T01:33:06.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:33:00+00:00, run_after=2024-07-04T01:34:00+00:00 2024-07-04T01:33:06.620304668Z [2024-07-04T01:33:06.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:06.622556218Z [2024-07-04T01:33:06.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:06.628466871Z [2024-07-04T01:33:06.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:32:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:03.205971+00:00, run_end_date=2024-07-04 01:33:05.359279+00:00, run_duration=2.153308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:00.461757+00:00, queued_by_job_id=2, pid=258 2024-07-04T01:33:06.628636835Z [2024-07-04T01:33:06.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:32:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:03.024612+00:00, run_end_date=2024-07-04 01:33:05.508092+00:00, run_duration=2.48348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:00.461757+00:00, queued_by_job_id=2, pid=257 2024-07-04T01:33:08.091923752Z [2024-07-04T01:33:08.091+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:33:08.091943190Z 2024-07-04T01:33:08.092052852Z [2024-07-04T01:33:08.091+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:33:08.094413997Z [2024-07-04T01:33:08.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:08.094431304Z 2024-07-04T01:33:08.097255305Z [2024-07-04T01:33:08.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:33:08.097472777Z [2024-07-04T01:33:08.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:08.154442127Z [2024-07-04T01:33:08.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:08.156662126Z [2024-07-04T01:33:08.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:08.170919587Z [2024-07-04T01:33:08.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T01:25:00+00:00, map_index=0, run_start_date=2024-07-04 01:33:07.248726+00:00, run_end_date=2024-07-04 01:33:07.552838+00:00, run_duration=0.304112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:05.257425+00:00, queued_by_job_id=2, pid=299 2024-07-04T01:33:08.171618007Z [2024-07-04T01:33:08.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2cd5d7d-38be-4842-a0a7-9a5e386db59b 2024-07-04T01:33:11.463514488Z [2024-07-04T01:33:11.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:33:11.463715449Z [2024-07-04T01:33:11.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:25:00+00:00, run_id=scheduled__2024-07-04T01:25:00+00:00, run_start_date=2024-07-04 01:32:57.558266+00:00, run_end_date=2024-07-04 01:33:11.463427+00:00, run_duration=13.905161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:25:00+00:00, data_interval_end=2024-07-04 01:30:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T01:33:11.470695785Z [2024-07-04T01:33:11.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:30:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:33:11.509510510Z [2024-07-04T01:33:11.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:11.514124745Z [2024-07-04T01:33:11.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T01:25:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:10.250072+00:00, run_end_date=2024-07-04 01:33:10.620110+00:00, run_duration=0.370038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:08.094869+00:00, queued_by_job_id=2, pid=311 2024-07-04T01:33:24.257964379Z [2024-07-04T01:33:24.257+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:33:24.300077060Z [2024-07-04T01:33:24.299+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:33:24.300115578Z 2024-07-04T01:33:24.300389206Z [2024-07-04T01:33:24.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:33:24.301039848Z [2024-07-04T01:33:24.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:24.301050938Z 2024-07-04T01:33:24.303095060Z [2024-07-04T01:33:24.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:33:24.303393446Z [2024-07-04T01:33:24.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:33:24.369910047Z [2024-07-04T01:33:24.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:24.374631576Z [2024-07-04T01:33:24.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c72cc86-4525-4a69-a324-77edc5fdbadd 2024-07-04T01:33:26.589710032Z [2024-07-04T01:33:26.589+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:33:00+00:00, run_after=2024-07-04T01:34:00+00:00 2024-07-04T01:33:26.640439006Z [2024-07-04T01:33:26.640+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:33:26.640473130Z 2024-07-04T01:33:26.640558302Z [2024-07-04T01:33:26.640+0000] {scheduler_job.py:425} INFO - DAG vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:33:26.641107041Z [2024-07-04T01:33:26.640+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:26.641119965Z 2024-07-04T01:33:26.643428863Z [2024-07-04T01:33:26.643+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:33:26.643462085Z [2024-07-04T01:33:26.643+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:33:26.686021302Z [2024-07-04T01:33:26.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:26.695170631Z [2024-07-04T01:33:26.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9965d262-0960-44d4-9bff-2e1b8a4dd444 2024-07-04T01:33:28.435014878Z [2024-07-04T01:33:28.434+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:33:28.435416193Z [2024-07-04T01:33:28.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, execution_date=2024-07-04 01:32:00+00:00, run_id=scheduled__2024-07-04T01:32:00+00:00, run_start_date=2024-07-04 01:33:24.272045+00:00, run_end_date=2024-07-04 01:33:28.434952+00:00, run_duration=4.162907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:32:00+00:00, data_interval_end=2024-07-04 01:33:00+00:00, dag_hash=e34930c4251ee84827c69b89186321ab 2024-07-04T01:33:28.446173405Z [2024-07-04T01:33:28.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:33:00+00:00, run_after=2024-07-04T01:34:00+00:00 2024-07-04T01:33:28.514463090Z [2024-07-04T01:33:28.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:28.521209454Z [2024-07-04T01:33:28.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:32:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:26.248491+00:00, run_end_date=2024-07-04 01:33:27.927759+00:00, run_duration=1.679268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:24.301426+00:00, queued_by_job_id=2, pid=323 2024-07-04T01:33:29.588142926Z [2024-07-04T01:33:29.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:30:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:33:29.681939540Z [2024-07-04T01:33:29.681+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:33:29.681984310Z 2024-07-04T01:33:29.683356743Z [2024-07-04T01:33:29.681+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:33:29.684169314Z [2024-07-04T01:33:29.683+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:29.684184919Z 2024-07-04T01:33:29.688452633Z [2024-07-04T01:33:29.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:33:29.688474935Z [2024-07-04T01:33:29.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:29.764688449Z [2024-07-04T01:33:29.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:29.773075478Z [2024-07-04T01:33:29.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to cab90f69-fffe-4c3f-b8e3-961ec53179e7 2024-07-04T01:33:31.025247213Z [2024-07-04T01:33:31.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:33:31.025636321Z [2024-07-04T01:33:31.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, execution_date=2024-07-04 01:32:00+00:00, run_id=scheduled__2024-07-04T01:32:00+00:00, run_start_date=2024-07-04 01:33:26.601789+00:00, run_end_date=2024-07-04 01:33:31.025258+00:00, run_duration=4.423469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:32:00+00:00, data_interval_end=2024-07-04 01:33:00+00:00, dag_hash=9e39d69690f8358a6a68ea9c1dc85dca 2024-07-04T01:33:31.036322192Z [2024-07-04T01:33:31.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:33:00+00:00, run_after=2024-07-04T01:34:00+00:00 2024-07-04T01:33:31.077345175Z [2024-07-04T01:33:31.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:31.085089868Z [2024-07-04T01:33:31.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:32:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:28.492527+00:00, run_end_date=2024-07-04 01:33:30.024534+00:00, run_duration=1.532007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:26.641430+00:00, queued_by_job_id=2, pid=344 2024-07-04T01:33:33.255393213Z [2024-07-04T01:33:33.255+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:33:33.255421143Z 2024-07-04T01:33:33.255665970Z [2024-07-04T01:33:33.255+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:33:33.256274521Z [2024-07-04T01:33:33.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:33.256289511Z 2024-07-04T01:33:33.258537840Z [2024-07-04T01:33:33.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='split_metrics', run_id='scheduled__2024-07-04T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T01:33:33.258636814Z [2024-07-04T01:33:33.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'split_metrics', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:33.326403575Z [2024-07-04T01:33:33.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.split_metrics run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:33.326748713Z [2024-07-04T01:33:33.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:33.334260556Z [2024-07-04T01:33:33.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:25:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:31.814141+00:00, run_end_date=2024-07-04 01:33:32.211370+00:00, run_duration=0.397229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:29.684637+00:00, queued_by_job_id=2, pid=365 2024-07-04T01:33:33.334523058Z [2024-07-04T01:33:33.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9dff867-7391-4252-bc4c-0de9d01740b4 2024-07-04T01:33:36.601137095Z [2024-07-04T01:33:36.600+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:33:36.601172498Z 2024-07-04T01:33:36.601323740Z [2024-07-04T01:33:36.601+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:33:36.602064177Z [2024-07-04T01:33:36.601+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:36.602117497Z 2024-07-04T01:33:36.604872543Z [2024-07-04T01:33:36.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='collect_metrics', run_id='scheduled__2024-07-04T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T01:33:36.604939664Z [2024-07-04T01:33:36.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'collect_metrics', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:33:36.665131138Z [2024-07-04T01:33:36.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.collect_metrics run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:36.665359542Z [2024-07-04T01:33:36.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.split_metrics run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:36.670416128Z [2024-07-04T01:33:36.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=split_metrics, run_id=scheduled__2024-07-04T01:25:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:35.067990+00:00, run_end_date=2024-07-04 01:33:35.417731+00:00, run_duration=0.349741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:33.256751+00:00, queued_by_job_id=2, pid=385 2024-07-04T01:33:36.670791893Z [2024-07-04T01:33:36.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51cfc609-7ead-40d4-8a87-253711a29b12 2024-07-04T01:33:39.906957004Z [2024-07-04T01:33:39.903+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:33:39.906989694Z 2024-07-04T01:33:39.906993933Z [2024-07-04T01:33:39.904+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:33:39.906997658Z [2024-07-04T01:33:39.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:33:39.907000834Z 2024-07-04T01:33:39.915061170Z [2024-07-04T01:33:39.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='send_prometheus', run_id='scheduled__2024-07-04T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:33:39.915080534Z [2024-07-04T01:33:39.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'send_prometheus', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:40.055033058Z [2024-07-04T01:33:40.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.send_prometheus run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status queued for try_number 1 2024-07-04T01:33:40.055055198Z [2024-07-04T01:33:40.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.collect_metrics run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:40.097121690Z [2024-07-04T01:33:40.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=collect_metrics, run_id=scheduled__2024-07-04T01:25:00+00:00, map_index=0, run_start_date=2024-07-04 01:33:38.442552+00:00, run_end_date=2024-07-04 01:33:38.894517+00:00, run_duration=0.451965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:36.602710+00:00, queued_by_job_id=2, pid=397 2024-07-04T01:33:40.097149488Z [2024-07-04T01:33:40.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e3c4578-b5ea-49a5-ab59-dfdba1dce0aa 2024-07-04T01:33:43.457058953Z [2024-07-04T01:33:43.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:33:43.457467414Z [2024-07-04T01:33:43.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, execution_date=2024-07-04 01:25:00+00:00, run_id=scheduled__2024-07-04T01:25:00+00:00, run_start_date=2024-07-04 01:33:29.610238+00:00, run_end_date=2024-07-04 01:33:43.456989+00:00, run_duration=13.846751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:25:00+00:00, data_interval_end=2024-07-04 01:30:00+00:00, dag_hash=56c44185c725c0b37427fea8acb48f7e 2024-07-04T01:33:43.464552381Z [2024-07-04T01:33:43.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:30:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:33:43.505249625Z [2024-07-04T01:33:43.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.send_prometheus run_id=scheduled__2024-07-04T01:25:00+00:00 exited with status success for try_number 1 2024-07-04T01:33:43.513801658Z [2024-07-04T01:33:43.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=send_prometheus, run_id=scheduled__2024-07-04T01:25:00+00:00, map_index=-1, run_start_date=2024-07-04 01:33:42.123663+00:00, run_end_date=2024-07-04 01:33:42.451491+00:00, run_duration=0.327828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:33:39.905576+00:00, queued_by_job_id=2, pid=409 2024-07-04T01:34:00.263776565Z [2024-07-04T01:34:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:34:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:34:00.279544453Z [2024-07-04T01:34:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:34:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:34:00.287138280Z [2024-07-04T01:34:00.286+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:34:00.294324285Z [2024-07-04T01:34:00.293+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:34:00.306011213Z [2024-07-04T01:34:00.305+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:34:00.648374166Z [2024-07-04T01:34:00.648+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-07-04T01:34:00.648396034Z 2024-07-04T01:34:00.648400751Z 2024-07-04T01:34:00.648403984Z 2024-07-04T01:34:00.648407275Z 2024-07-04T01:34:00.648410536Z 2024-07-04T01:34:00.648466706Z [2024-07-04T01:34:00.648+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:34:00.648553212Z [2024-07-04T01:34:00.648+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:34:00.648625564Z [2024-07-04T01:34:00.648+0000] {scheduler_job.py:425} INFO - DAG vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:34:00.648772330Z [2024-07-04T01:34:00.648+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:34:00.648787657Z [2024-07-04T01:34:00.648+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:34:00.649362563Z [2024-07-04T01:34:00.649+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:34:00.649383949Z 2024-07-04T01:34:00.649427592Z 2024-07-04T01:34:00.649434594Z 2024-07-04T01:34:00.649439542Z 2024-07-04T01:34:00.649444410Z 2024-07-04T01:34:00.660868922Z [2024-07-04T01:34:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:34:00.660972747Z [2024-07-04T01:34:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:34:00.661491740Z [2024-07-04T01:34:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:34:00.661587294Z [2024-07-04T01:34:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:34:00.661747347Z [2024-07-04T01:34:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:34:00.661817942Z [2024-07-04T01:34:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:34:00.662047409Z [2024-07-04T01:34:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:34:00.662054968Z [2024-07-04T01:34:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:34:00.662342658Z [2024-07-04T01:34:00.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:34:00.662356566Z [2024-07-04T01:34:00.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:34:01.464421204Z [2024-07-04T01:34:01.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status queued for try_number 1 2024-07-04T01:34:01.467334313Z [2024-07-04T01:34:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status queued for try_number 1 2024-07-04T01:34:01.467660214Z [2024-07-04T01:34:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status queued for try_number 1 2024-07-04T01:34:01.467850636Z [2024-07-04T01:34:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status queued for try_number 1 2024-07-04T01:34:01.468000961Z [2024-07-04T01:34:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status queued for try_number 1 2024-07-04T01:34:01.503271045Z [2024-07-04T01:34:01.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 667461f5-bcb1-481d-a12f-238f3834c62d 2024-07-04T01:34:01.511127730Z [2024-07-04T01:34:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7efd510d-a7f4-477d-a5c2-108cdf109842 2024-07-04T01:34:01.511455092Z [2024-07-04T01:34:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to adc7fe18-f88b-4e9a-b011-6b08070845ff 2024-07-04T01:34:01.511769009Z [2024-07-04T01:34:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 737a78dc-80a5-4b2f-9e3b-e41ab1327e25 2024-07-04T01:34:01.511991438Z [2024-07-04T01:34:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84d95353-db4b-4274-bcad-6836883b1197 2024-07-04T01:34:04.122330684Z [2024-07-04T01:34:04.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:34:04.123405329Z [2024-07-04T01:34:04.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:32:00+00:00, run_id=scheduled__2024-07-04T01:32:00+00:00, run_start_date=2024-07-04 01:34:00.347128+00:00, run_end_date=2024-07-04 01:34:04.122283+00:00, run_duration=3.775155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:32:00+00:00, data_interval_end=2024-07-04 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:34:04.143001100Z [2024-07-04T01:34:04.142+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:34:00+00:00, run_after=2024-07-04T01:36:00+00:00 2024-07-04T01:34:04.269474720Z [2024-07-04T01:34:04.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:32:00+00:00 exited with status success for try_number 1 2024-07-04T01:34:04.281385108Z [2024-07-04T01:34:04.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:32:00+00:00, map_index=-1, run_start_date=2024-07-04 01:34:02.533749+00:00, run_end_date=2024-07-04 01:34:03.350246+00:00, run_duration=0.816497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:34:00.650357+00:00, queued_by_job_id=2, pid=428 2024-07-04T01:34:04.818627587Z [2024-07-04T01:34:04.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status failed for try_number 1 2024-07-04T01:34:04.831147816Z [2024-07-04T01:34:04.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:34:00.650357+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:34:04.831562351Z [2024-07-04T01:34:04.831+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:34:04.837385653Z [2024-07-04T01:34:04.834+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:34:04.860136445Z [2024-07-04T01:34:04.859+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T013300, start_date=, end_date=20240704T013404 2024-07-04T01:34:06.074141694Z [2024-07-04T01:34:06.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status failed for try_number 1 2024-07-04T01:34:06.085047057Z [2024-07-04T01:34:06.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:34:00.650357+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:34:06.085695992Z [2024-07-04T01:34:06.085+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:34:06.090502312Z [2024-07-04T01:34:06.090+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:34:06.112696057Z [2024-07-04T01:34:06.112+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T013300, start_date=, end_date=20240704T013406 2024-07-04T01:34:07.176219985Z [2024-07-04T01:34:07.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:34:07.177619332Z [2024-07-04T01:34:07.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:33:00+00:00, run_id=scheduled__2024-07-04T01:33:00+00:00, run_start_date=2024-07-04 01:34:00.367605+00:00, run_end_date=2024-07-04 01:34:07.176164+00:00, run_duration=6.808559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:33:00+00:00, data_interval_end=2024-07-04 01:34:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:34:07.186767302Z [2024-07-04T01:34:07.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:34:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:34:07.194070327Z [2024-07-04T01:34:07.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:34:07.194238662Z [2024-07-04T01:34:07.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:33:00+00:00, run_id=scheduled__2024-07-04T01:33:00+00:00, run_start_date=2024-07-04 01:34:00.353583+00:00, run_end_date=2024-07-04 01:34:07.194018+00:00, run_duration=6.840435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:33:00+00:00, data_interval_end=2024-07-04 01:34:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:34:07.207270396Z [2024-07-04T01:34:07.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:34:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:34:07.260633534Z [2024-07-04T01:34:07.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status success for try_number 1 2024-07-04T01:34:07.260700686Z [2024-07-04T01:34:07.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status success for try_number 1 2024-07-04T01:34:07.268369105Z [2024-07-04T01:34:07.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:33:00+00:00, map_index=-1, run_start_date=2024-07-04 01:34:04.685600+00:00, run_end_date=2024-07-04 01:34:06.459893+00:00, run_duration=1.774293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:34:00.650357+00:00, queued_by_job_id=2, pid=489 2024-07-04T01:34:07.268521425Z [2024-07-04T01:34:07.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:33:00+00:00, map_index=-1, run_start_date=2024-07-04 01:34:04.816183+00:00, run_end_date=2024-07-04 01:34:06.970452+00:00, run_duration=2.154269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:34:00.650357+00:00, queued_by_job_id=2, pid=493 2024-07-04T01:34:15.021307744Z [2024-07-04T01:34:15.020+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:34:15.021329608Z 2024-07-04T01:34:15.021781363Z [2024-07-04T01:34:15.021+0000] {scheduler_job.py:425} INFO - DAG vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:34:15.022508459Z [2024-07-04T01:34:15.022+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:34:15.022523383Z 2024-07-04T01:34:15.027048850Z [2024-07-04T01:34:15.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:34:15.027402530Z [2024-07-04T01:34:15.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:34:15.115359186Z [2024-07-04T01:34:15.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status queued for try_number 2 2024-07-04T01:34:15.124609073Z [2024-07-04T01:34:15.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35f0851c-5478-4384-8d08-ce87e72eadb7 2024-07-04T01:34:16.322155196Z [2024-07-04T01:34:16.321+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:34:16.322183568Z 2024-07-04T01:34:16.322244168Z [2024-07-04T01:34:16.322+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:34:16.322759933Z [2024-07-04T01:34:16.322+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:34:16.322771970Z 2024-07-04T01:34:16.324884673Z [2024-07-04T01:34:16.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:34:16.324970007Z [2024-07-04T01:34:16.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:34:16.409438933Z [2024-07-04T01:34:16.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status queued for try_number 2 2024-07-04T01:34:16.415924607Z [2024-07-04T01:34:16.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f558438-e67e-430e-b342-f3444f2e65bf 2024-07-04T01:34:17.587820752Z [2024-07-04T01:34:17.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status failed for try_number 2 2024-07-04T01:34:17.604804778Z [2024-07-04T01:34:17.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:34:04.838828+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:34:15.023272+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:34:17.605349267Z [2024-07-04T01:34:17.605+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:34:17.607976122Z [2024-07-04T01:34:17.607+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:34:17.627495976Z [2024-07-04T01:34:17.627+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T013300, start_date=, end_date=20240704T013417 2024-07-04T01:34:18.697922335Z [2024-07-04T01:34:18.697+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T01:34:18.698182695Z [2024-07-04T01:34:18.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, execution_date=2024-07-04 01:33:00+00:00, run_id=scheduled__2024-07-04T01:33:00+00:00, run_start_date=2024-07-04 01:34:00.355154+00:00, run_end_date=2024-07-04 01:34:18.697864+00:00, run_duration=18.34271, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:33:00+00:00, data_interval_end=2024-07-04 01:34:00+00:00, dag_hash=9e39d69690f8358a6a68ea9c1dc85dca 2024-07-04T01:34:18.710656287Z [2024-07-04T01:34:18.710+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:34:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:34:18.793453547Z [2024-07-04T01:34:18.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:33:00+00:00 exited with status failed for try_number 2 2024-07-04T01:34:18.802900409Z [2024-07-04T01:34:18.802+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:34:06.095318+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:34:16.323057+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:34:18.803412132Z [2024-07-04T01:34:18.803+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:34:18.806823787Z [2024-07-04T01:34:18.806+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:34:18.825972129Z [2024-07-04T01:34:18.825+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T013300, start_date=, end_date=20240704T013418 2024-07-04T01:34:19.608134183Z [2024-07-04T01:34:19.607+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T01:34:19.608751347Z [2024-07-04T01:34:19.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, execution_date=2024-07-04 01:33:00+00:00, run_id=scheduled__2024-07-04T01:33:00+00:00, run_start_date=2024-07-04 01:34:00.361468+00:00, run_end_date=2024-07-04 01:34:19.608402+00:00, run_duration=19.246934, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:33:00+00:00, data_interval_end=2024-07-04 01:34:00+00:00, dag_hash=e34930c4251ee84827c69b89186321ab 2024-07-04T01:34:19.623663380Z [2024-07-04T01:34:19.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:34:00+00:00, run_after=2024-07-04T01:35:00+00:00 2024-07-04T01:35:00.419507150Z [2024-07-04T01:35:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:36:00+00:00 2024-07-04T01:35:00.450910601Z [2024-07-04T01:35:00.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:35:00.498190704Z [2024-07-04T01:35:00.497+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:35:00.537100927Z [2024-07-04T01:35:00.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:36:00+00:00 2024-07-04T01:35:00.546506707Z [2024-07-04T01:35:00.546+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:35:00.564311162Z [2024-07-04T01:35:00.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:35:00.698796824Z [2024-07-04T01:35:00.698+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-07-04T01:35:00.698834406Z 2024-07-04T01:35:00.698837905Z 2024-07-04T01:35:00.698844888Z 2024-07-04T01:35:00.698849185Z 2024-07-04T01:35:00.698852384Z 2024-07-04T01:35:00.698855840Z 2024-07-04T01:35:00.698892639Z [2024-07-04T01:35:00.698+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:35:00.698996768Z [2024-07-04T01:35:00.698+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:35:00.699265144Z [2024-07-04T01:35:00.699+0000] {scheduler_job.py:425} INFO - DAG vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:35:00.699815492Z [2024-07-04T01:35:00.699+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:35:00.700002968Z [2024-07-04T01:35:00.699+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:35:00.700155357Z [2024-07-04T01:35:00.699+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:35:00.700848038Z [2024-07-04T01:35:00.700+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:35:00.700860031Z 2024-07-04T01:35:00.700875968Z 2024-07-04T01:35:00.700879735Z 2024-07-04T01:35:00.700898373Z 2024-07-04T01:35:00.700901393Z 2024-07-04T01:35:00.700904411Z 2024-07-04T01:35:00.707489578Z [2024-07-04T01:35:00.707+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:35:00.707546244Z [2024-07-04T01:35:00.707+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:00.708356917Z [2024-07-04T01:35:00.708+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:35:00.708468963Z [2024-07-04T01:35:00.708+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:00.708789530Z [2024-07-04T01:35:00.708+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:35:00.709402502Z [2024-07-04T01:35:00.708+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:35:00.709972708Z [2024-07-04T01:35:00.709+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:35:00.710347712Z [2024-07-04T01:35:00.709+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:35:00.711624008Z [2024-07-04T01:35:00.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:35:00.712167273Z [2024-07-04T01:35:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:35:00.712525117Z [2024-07-04T01:35:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:35:00.712714844Z [2024-07-04T01:35:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:35:01.768216824Z [2024-07-04T01:35:01.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:35:01.768259484Z [2024-07-04T01:35:01.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:35:01.768564911Z [2024-07-04T01:35:01.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status queued for try_number 1 2024-07-04T01:35:01.768654606Z [2024-07-04T01:35:01.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status queued for try_number 1 2024-07-04T01:35:01.768717829Z [2024-07-04T01:35:01.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status queued for try_number 1 2024-07-04T01:35:01.768780529Z [2024-07-04T01:35:01.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status queued for try_number 1 2024-07-04T01:35:01.812833965Z [2024-07-04T01:35:01.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc5fecdd-f046-4ff8-8e0d-466ffa6c3a94 2024-07-04T01:35:01.812948668Z [2024-07-04T01:35:01.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to e31e5de4-f908-44f9-bc73-91eea1a87d14 2024-07-04T01:35:01.813997286Z [2024-07-04T01:35:01.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78746536-b3e0-4ab6-aac9-e5003c35ec50 2024-07-04T01:35:01.814206956Z [2024-07-04T01:35:01.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8ed6736-efe0-44aa-9c2c-a1cdb22690d8 2024-07-04T01:35:01.814361802Z [2024-07-04T01:35:01.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e478f30-3050-401c-a731-1a2e5ced4535 2024-07-04T01:35:01.814478931Z [2024-07-04T01:35:01.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cf8bd5d-02b5-4ceb-a19f-9b83b2d9cfc2 2024-07-04T01:35:06.909220095Z [2024-07-04T01:35:06.908+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:35:06.909242521Z 2024-07-04T01:35:06.909360213Z [2024-07-04T01:35:06.909+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:35:06.910070417Z [2024-07-04T01:35:06.909+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:35:06.910083222Z 2024-07-04T01:35:06.913340051Z [2024-07-04T01:35:06.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T01:35:06.913449995Z [2024-07-04T01:35:06.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:06.962574865Z [2024-07-04T01:35:06.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:35:06.962618847Z [2024-07-04T01:35:06.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status failed for try_number 1 2024-07-04T01:35:06.962671485Z [2024-07-04T01:35:06.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status success for try_number 1 2024-07-04T01:35:06.962819233Z [2024-07-04T01:35:06.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status failed for try_number 1 2024-07-04T01:35:06.962827665Z [2024-07-04T01:35:06.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status failed for try_number 1 2024-07-04T01:35:06.980085156Z [2024-07-04T01:35:06.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:00.702201+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:35:06.980486794Z [2024-07-04T01:35:06.980+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:06.982719293Z [2024-07-04T01:35:06.982+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:07.000343887Z [2024-07-04T01:35:06.999+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T013400, start_date=, end_date=20240704T013506 2024-07-04T01:35:07.013393044Z [2024-07-04T01:35:07.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:00.702201+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:35:07.013950260Z [2024-07-04T01:35:07.013+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:07.017651718Z [2024-07-04T01:35:07.017+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:07.028799841Z [2024-07-04T01:35:07.028+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=extract_metrics_from_vnfrs, execution_date=20240704T013000, start_date=, end_date=20240704T013507 2024-07-04T01:35:07.035713436Z [2024-07-04T01:35:07.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:00.702201+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:35:07.036283156Z [2024-07-04T01:35:07.036+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:07.038290839Z [2024-07-04T01:35:07.038+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:07.049248085Z [2024-07-04T01:35:07.049+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T013400, start_date=, end_date=20240704T013507 2024-07-04T01:35:07.064785187Z [2024-07-04T01:35:07.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=-1, run_start_date=2024-07-04 01:35:04.899713+00:00, run_end_date=2024-07-04 01:35:06.097305+00:00, run_duration=1.197592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:00.702201+00:00, queued_by_job_id=2, pid=588 2024-07-04T01:35:07.065817922Z [2024-07-04T01:35:07.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to de3974f2-cb51-409e-9311-ac3329a60289 2024-07-04T01:35:08.074311305Z [2024-07-04T01:35:08.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:35:08.074961200Z [2024-07-04T01:35:08.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:34:00+00:00, run_id=scheduled__2024-07-04T01:34:00+00:00, run_start_date=2024-07-04 01:35:00.583899+00:00, run_end_date=2024-07-04 01:35:08.074290+00:00, run_duration=7.490391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:34:00+00:00, data_interval_end=2024-07-04 01:35:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:35:08.090462733Z [2024-07-04T01:35:08.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:36:00+00:00 2024-07-04T01:35:08.101693618Z [2024-07-04T01:35:08.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:35:08.102259122Z [2024-07-04T01:35:08.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:34:00+00:00, run_id=scheduled__2024-07-04T01:34:00+00:00, run_start_date=2024-07-04 01:35:00.585514+00:00, run_end_date=2024-07-04 01:35:08.101664+00:00, run_duration=7.51615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:34:00+00:00, data_interval_end=2024-07-04 01:35:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:35:08.119518240Z [2024-07-04T01:35:08.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:36:00+00:00 2024-07-04T01:35:08.217175218Z [2024-07-04T01:35:08.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status success for try_number 1 2024-07-04T01:35:08.217373940Z [2024-07-04T01:35:08.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status success for try_number 1 2024-07-04T01:35:08.225370454Z [2024-07-04T01:35:08.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:34:00+00:00, map_index=-1, run_start_date=2024-07-04 01:35:05.924653+00:00, run_end_date=2024-07-04 01:35:07.753966+00:00, run_duration=1.829313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:00.702201+00:00, queued_by_job_id=2, pid=623 2024-07-04T01:35:08.225631180Z [2024-07-04T01:35:08.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:34:00+00:00, map_index=-1, run_start_date=2024-07-04 01:35:06.016335+00:00, run_end_date=2024-07-04 01:35:07.518806+00:00, run_duration=1.502471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:00.702201+00:00, queued_by_job_id=2, pid=631 2024-07-04T01:35:10.525490211Z [2024-07-04T01:35:10.525+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:35:10.525514341Z 2024-07-04T01:35:10.527601862Z [2024-07-04T01:35:10.527+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:35:10.528734207Z [2024-07-04T01:35:10.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:35:10.528745532Z 2024-07-04T01:35:10.532361639Z [2024-07-04T01:35:10.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T01:35:10.532598625Z [2024-07-04T01:35:10.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:35:10.631989765Z [2024-07-04T01:35:10.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:35:10.632279323Z [2024-07-04T01:35:10.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status success for try_number 1 2024-07-04T01:35:10.652050944Z [2024-07-04T01:35:10.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=-1, run_start_date=2024-07-04 01:35:08.869479+00:00, run_end_date=2024-07-04 01:35:09.318444+00:00, run_duration=0.448965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:06.910854+00:00, queued_by_job_id=2, pid=703 2024-07-04T01:35:10.652175235Z [2024-07-04T01:35:10.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ba4d1f0-c09b-41f1-9e8c-31ea868233c0 2024-07-04T01:35:13.373173632Z [2024-07-04T01:35:13.372+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:35:13.373212278Z 2024-07-04T01:35:13.373242675Z [2024-07-04T01:35:13.373+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:35:13.374214038Z [2024-07-04T01:35:13.373+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:35:13.374241500Z 2024-07-04T01:35:13.378586752Z [2024-07-04T01:35:13.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:35:13.378610997Z [2024-07-04T01:35:13.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:13.429613610Z [2024-07-04T01:35:13.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:35:13.429660293Z [2024-07-04T01:35:13.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status success for try_number 1 2024-07-04T01:35:13.438692106Z [2024-07-04T01:35:13.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=0, run_start_date=2024-07-04 01:35:12.601066+00:00, run_end_date=2024-07-04 01:35:13.015613+00:00, run_duration=0.414547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:10.529752+00:00, queued_by_job_id=2, pid=715 2024-07-04T01:35:13.439108930Z [2024-07-04T01:35:13.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53e073b7-58e8-4c49-b87d-183a04e65be7 2024-07-04T01:35:15.797145136Z [2024-07-04T01:35:15.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:35:15.797989464Z [2024-07-04T01:35:15.797+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:30:00+00:00, run_id=scheduled__2024-07-04T01:30:00+00:00, run_start_date=2024-07-04 01:35:00.580822+00:00, run_end_date=2024-07-04 01:35:15.797109+00:00, run_duration=15.216287, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:30:00+00:00, data_interval_end=2024-07-04 01:35:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T01:35:15.805459070Z [2024-07-04T01:35:15.805+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:35:15.890636597Z [2024-07-04T01:35:15.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status success for try_number 1 2024-07-04T01:35:15.897820474Z [2024-07-04T01:35:15.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=-1, run_start_date=2024-07-04 01:35:15.213475+00:00, run_end_date=2024-07-04 01:35:15.569973+00:00, run_duration=0.356498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:13.374552+00:00, queued_by_job_id=2, pid=727 2024-07-04T01:35:17.368074317Z [2024-07-04T01:35:17.367+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:35:17.368092712Z 2024-07-04T01:35:17.368097097Z 2024-07-04T01:35:17.368100576Z 2024-07-04T01:35:17.368181099Z [2024-07-04T01:35:17.367+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:35:17.368377855Z [2024-07-04T01:35:17.368+0000] {scheduler_job.py:425} INFO - DAG vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:35:17.368529997Z [2024-07-04T01:35:17.368+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 has 0/16 running and queued tasks 2024-07-04T01:35:17.369142346Z [2024-07-04T01:35:17.368+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:35:17.369171890Z 2024-07-04T01:35:17.369182170Z 2024-07-04T01:35:17.369190904Z 2024-07-04T01:35:17.373410915Z [2024-07-04T01:35:17.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:35:17.373612876Z [2024-07-04T01:35:17.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:17.373942835Z [2024-07-04T01:35:17.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:34:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:35:17.374300197Z [2024-07-04T01:35:17.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:35:17.374609874Z [2024-07-04T01:35:17.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:34:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:35:17.374785846Z [2024-07-04T01:35:17.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:35:17.722255412Z [2024-07-04T01:35:17.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 2 2024-07-04T01:35:17.723025206Z [2024-07-04T01:35:17.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status queued for try_number 2 2024-07-04T01:35:17.723290584Z [2024-07-04T01:35:17.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status queued for try_number 2 2024-07-04T01:35:17.743415013Z [2024-07-04T01:35:17.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed27f44c-cfe6-41d3-bf66-612621d1e37c 2024-07-04T01:35:17.743980220Z [2024-07-04T01:35:17.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to f58a310a-6775-45ae-a83d-7da1a4a04907 2024-07-04T01:35:17.744392883Z [2024-07-04T01:35:17.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 861020b8-71cb-40ff-962e-4c626f649d07 2024-07-04T01:35:20.399076231Z [2024-07-04T01:35:20.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status failed for try_number 2 2024-07-04T01:35:20.400255153Z [2024-07-04T01:35:20.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status failed for try_number 2 2024-07-04T01:35:20.400437026Z [2024-07-04T01:35:20.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status failed for try_number 2 2024-07-04T01:35:20.439438684Z [2024-07-04T01:35:20.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:35:06.985140+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:17.369829+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:35:20.439972699Z [2024-07-04T01:35:20.439+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:20.449089347Z [2024-07-04T01:35:20.448+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:20.482153372Z [2024-07-04T01:35:20.481+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T013400, start_date=, end_date=20240704T013520 2024-07-04T01:35:20.516778441Z [2024-07-04T01:35:20.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:35:07.020354+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:17.369829+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:35:20.518024378Z [2024-07-04T01:35:20.517+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:20.528565488Z [2024-07-04T01:35:20.528+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:20.552357276Z [2024-07-04T01:35:20.552+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=extract_metrics_from_vnfrs, execution_date=20240704T013000, start_date=, end_date=20240704T013520 2024-07-04T01:35:20.561552336Z [2024-07-04T01:35:20.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:35:07.040319+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:35:17.369829+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:35:20.562107421Z [2024-07-04T01:35:20.561+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:20.567748459Z [2024-07-04T01:35:20.567+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:35:20.608931875Z [2024-07-04T01:35:20.608+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T013400, start_date=, end_date=20240704T013520 2024-07-04T01:35:21.294690785Z [2024-07-04T01:35:21.294+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T01:35:21.295178313Z [2024-07-04T01:35:21.294+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71, execution_date=2024-07-04 01:34:00+00:00, run_id=scheduled__2024-07-04T01:34:00+00:00, run_start_date=2024-07-04 01:35:00.582444+00:00, run_end_date=2024-07-04 01:35:21.294771+00:00, run_duration=20.712327, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:34:00+00:00, data_interval_end=2024-07-04 01:35:00+00:00, dag_hash=9e39d69690f8358a6a68ea9c1dc85dca 2024-07-04T01:35:21.306955953Z [2024-07-04T01:35:21.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:36:00+00:00 2024-07-04T01:35:21.314697249Z [2024-07-04T01:35:21.314+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T01:35:21.315204714Z [2024-07-04T01:35:21.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71, execution_date=2024-07-04 01:34:00+00:00, run_id=scheduled__2024-07-04T01:34:00+00:00, run_start_date=2024-07-04 01:35:00.586564+00:00, run_end_date=2024-07-04 01:35:21.314841+00:00, run_duration=20.728277, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:34:00+00:00, data_interval_end=2024-07-04 01:35:00+00:00, dag_hash=e34930c4251ee84827c69b89186321ab 2024-07-04T01:35:21.325401612Z [2024-07-04T01:35:21.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:36:00+00:00 2024-07-04T01:36:00.465994914Z [2024-07-04T01:36:00.465+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:36:00.477582663Z [2024-07-04T01:36:00.477+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:36:00.498506148Z [2024-07-04T01:36:00.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:36:00+00:00, run_after=2024-07-04T01:37:00+00:00 2024-07-04T01:36:00.624233737Z [2024-07-04T01:36:00.623+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:36:00.624272667Z 2024-07-04T01:36:00.624277373Z 2024-07-04T01:36:00.624281113Z 2024-07-04T01:36:00.624887413Z [2024-07-04T01:36:00.624+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:36:00.626069444Z [2024-07-04T01:36:00.624+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:36:00.626313529Z [2024-07-04T01:36:00.626+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:36:00.627046326Z [2024-07-04T01:36:00.626+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:36:00.627058792Z 2024-07-04T01:36:00.627063298Z 2024-07-04T01:36:00.627066666Z 2024-07-04T01:36:00.632658518Z [2024-07-04T01:36:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:36:00.633006480Z [2024-07-04T01:36:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:36:00.633387130Z [2024-07-04T01:36:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:36:00.633622733Z [2024-07-04T01:36:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:36:00.633904765Z [2024-07-04T01:36:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:36:00.634089848Z [2024-07-04T01:36:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:36:01.065086227Z [2024-07-04T01:36:01.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status queued for try_number 1 2024-07-04T01:36:01.065362649Z [2024-07-04T01:36:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 1 2024-07-04T01:36:01.065426958Z [2024-07-04T01:36:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 1 2024-07-04T01:36:01.083228760Z [2024-07-04T01:36:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc65bea1-f8a1-44a2-b1c9-dafd959e49f7 2024-07-04T01:36:01.083691038Z [2024-07-04T01:36:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e008f26-b6cd-4859-b77a-df9fc96755e3 2024-07-04T01:36:01.084028981Z [2024-07-04T01:36:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3626f3bd-cab7-4c9b-9ca8-19e26eea8d3a 2024-07-04T01:36:03.400517511Z [2024-07-04T01:36:03.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:36:03.401060256Z [2024-07-04T01:36:03.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:34:00+00:00, run_id=scheduled__2024-07-04T01:34:00+00:00, run_start_date=2024-07-04 01:36:00.515316+00:00, run_end_date=2024-07-04 01:36:03.400694+00:00, run_duration=2.885378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:34:00+00:00, data_interval_end=2024-07-04 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:36:03.418436552Z [2024-07-04T01:36:03.418+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:36:00+00:00, run_after=2024-07-04T01:38:00+00:00 2024-07-04T01:36:03.489643191Z [2024-07-04T01:36:03.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:34:00+00:00 exited with status success for try_number 1 2024-07-04T01:36:03.502571094Z [2024-07-04T01:36:03.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:34:00+00:00, map_index=-1, run_start_date=2024-07-04 01:36:02.046131+00:00, run_end_date=2024-07-04 01:36:02.412685+00:00, run_duration=0.366554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:36:00.628253+00:00, queued_by_job_id=2, pid=804 2024-07-04T01:36:05.704668906Z [2024-07-04T01:36:05.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:36:05.706532917Z [2024-07-04T01:36:05.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:35:00+00:00, run_id=scheduled__2024-07-04T01:35:00+00:00, run_start_date=2024-07-04 01:36:00.524576+00:00, run_end_date=2024-07-04 01:36:05.706147+00:00, run_duration=5.181571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:35:00+00:00, data_interval_end=2024-07-04 01:36:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:36:05.717394458Z [2024-07-04T01:36:05.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:36:00+00:00, run_after=2024-07-04T01:37:00+00:00 2024-07-04T01:36:05.771003034Z [2024-07-04T01:36:05.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status success for try_number 1 2024-07-04T01:36:05.780410826Z [2024-07-04T01:36:05.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=-1, run_start_date=2024-07-04 01:36:03.164888+00:00, run_end_date=2024-07-04 01:36:05.324725+00:00, run_duration=2.159837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:36:00.628253+00:00, queued_by_job_id=2, pid=834 2024-07-04T01:36:06.261155448Z [2024-07-04T01:36:06.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:36:06.261584485Z [2024-07-04T01:36:06.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:35:00+00:00, run_id=scheduled__2024-07-04T01:35:00+00:00, run_start_date=2024-07-04 01:36:00.521913+00:00, run_end_date=2024-07-04 01:36:06.261123+00:00, run_duration=5.73921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:35:00+00:00, data_interval_end=2024-07-04 01:36:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:36:06.277830389Z [2024-07-04T01:36:06.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:36:00+00:00, run_after=2024-07-04T01:37:00+00:00 2024-07-04T01:36:06.321733924Z [2024-07-04T01:36:06.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status success for try_number 1 2024-07-04T01:36:06.329014793Z [2024-07-04T01:36:06.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=-1, run_start_date=2024-07-04 01:36:03.241537+00:00, run_end_date=2024-07-04 01:36:06.145576+00:00, run_duration=2.904039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:36:00.628253+00:00, queued_by_job_id=2, pid=835 2024-07-04T01:36:20.899106251Z [2024-07-04T01:36:20.898+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T01:36:38.560825787Z [2024-07-04T01:36:38.560+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:36:38.661972681Z [2024-07-04T01:36:38.661+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:36:38.661989808Z 2024-07-04T01:36:38.661993606Z [2024-07-04T01:36:38.661+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:36:38.663069047Z [2024-07-04T01:36:38.662+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:36:38.663081535Z 2024-07-04T01:36:38.665425172Z [2024-07-04T01:36:38.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:36:38.665447494Z [2024-07-04T01:36:38.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:36:38.839922230Z [2024-07-04T01:36:38.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 1 2024-07-04T01:36:38.855588654Z [2024-07-04T01:36:38.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5202f821-91be-4f41-83f2-edae172c5220 2024-07-04T01:36:40.253675156Z [2024-07-04T01:36:40.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:36:00+00:00, run_after=2024-07-04T01:37:00+00:00 2024-07-04T01:36:40.310606285Z [2024-07-04T01:36:40.310+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:36:40.310626797Z 2024-07-04T01:36:40.310771103Z [2024-07-04T01:36:40.310+0000] {scheduler_job.py:425} INFO - DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:36:40.311463357Z [2024-07-04T01:36:40.311+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:36:40.311475696Z 2024-07-04T01:36:40.314110919Z [2024-07-04T01:36:40.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:36:40.315250277Z [2024-07-04T01:36:40.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:36:40.525734325Z [2024-07-04T01:36:40.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 1 2024-07-04T01:36:40.534426425Z [2024-07-04T01:36:40.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fa12a84-8013-40a5-a1b3-8083f66ff0a4 2024-07-04T01:36:42.954148148Z [2024-07-04T01:36:42.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:36:43.038541057Z [2024-07-04T01:36:43.038+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:36:43.038557802Z 2024-07-04T01:36:43.038772297Z [2024-07-04T01:36:43.038+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:36:43.040071531Z [2024-07-04T01:36:43.039+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:36:43.040086477Z 2024-07-04T01:36:43.042825270Z [2024-07-04T01:36:43.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:36:43.043895137Z [2024-07-04T01:36:43.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:36:43.102483391Z [2024-07-04T01:36:43.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:36:43.111775750Z [2024-07-04T01:36:43.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60562eb2-7c4b-43a8-86e7-99eca7c4f1c3 2024-07-04T01:36:43.162282412Z [2024-07-04T01:36:43.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:36:43.164236558Z [2024-07-04T01:36:43.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:35:00+00:00, run_id=scheduled__2024-07-04T01:35:00+00:00, run_start_date=2024-07-04 01:36:38.590802+00:00, run_end_date=2024-07-04 01:36:43.163867+00:00, run_duration=4.573065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:35:00+00:00, data_interval_end=2024-07-04 01:36:00+00:00, dag_hash=3bc69dfe47ffd351686f168b6171ee80 2024-07-04T01:36:43.175735838Z [2024-07-04T01:36:43.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:36:00+00:00, run_after=2024-07-04T01:37:00+00:00 2024-07-04T01:36:44.283401453Z [2024-07-04T01:36:44.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status success for try_number 1 2024-07-04T01:36:44.294139614Z [2024-07-04T01:36:44.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=-1, run_start_date=2024-07-04 01:36:41.246251+00:00, run_end_date=2024-07-04 01:36:43.126695+00:00, run_duration=1.880444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:36:38.662623+00:00, queued_by_job_id=2, pid=866 2024-07-04T01:36:45.355518521Z [2024-07-04T01:36:45.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:36:45.355969741Z [2024-07-04T01:36:45.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:35:00+00:00, run_id=scheduled__2024-07-04T01:35:00+00:00, run_start_date=2024-07-04 01:36:40.267138+00:00, run_end_date=2024-07-04 01:36:45.355611+00:00, run_duration=5.088473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:35:00+00:00, data_interval_end=2024-07-04 01:36:00+00:00, dag_hash=b7541a35136af9db48a9f03e98535b6f 2024-07-04T01:36:45.365853050Z [2024-07-04T01:36:45.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:36:00+00:00, run_after=2024-07-04T01:37:00+00:00 2024-07-04T01:36:45.414184862Z [2024-07-04T01:36:45.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status success for try_number 1 2024-07-04T01:36:45.419166506Z [2024-07-04T01:36:45.418+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=-1, run_start_date=2024-07-04 01:36:43.012459+00:00, run_end_date=2024-07-04 01:36:44.333018+00:00, run_duration=1.320559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:36:40.311908+00:00, queued_by_job_id=2, pid=885 2024-07-04T01:36:46.516335319Z [2024-07-04T01:36:46.515+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:36:46.516356842Z 2024-07-04T01:36:46.517268060Z [2024-07-04T01:36:46.516+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:36:46.518005125Z [2024-07-04T01:36:46.517+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:36:46.518027157Z 2024-07-04T01:36:46.523408142Z [2024-07-04T01:36:46.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='split_metrics', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T01:36:46.524614330Z [2024-07-04T01:36:46.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'split_metrics', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:36:46.612798641Z [2024-07-04T01:36:46.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.split_metrics run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:36:46.615026102Z [2024-07-04T01:36:46.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status success for try_number 1 2024-07-04T01:36:46.623791260Z [2024-07-04T01:36:46.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99eaff5e-c70b-4790-b95e-33a991415c47 2024-07-04T01:36:46.624072078Z [2024-07-04T01:36:46.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=-1, run_start_date=2024-07-04 01:36:45.104282+00:00, run_end_date=2024-07-04 01:36:45.471321+00:00, run_duration=0.367039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:36:43.040826+00:00, queued_by_job_id=2, pid=906 2024-07-04T01:36:49.425874393Z [2024-07-04T01:36:49.425+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:36:49.425895532Z 2024-07-04T01:36:49.426078966Z [2024-07-04T01:36:49.425+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:36:49.426727612Z [2024-07-04T01:36:49.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:36:49.426750087Z 2024-07-04T01:36:49.429533607Z [2024-07-04T01:36:49.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='collect_metrics', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T01:36:49.430533509Z [2024-07-04T01:36:49.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'collect_metrics', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:36:49.550143098Z [2024-07-04T01:36:49.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.collect_metrics run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:36:49.550224921Z [2024-07-04T01:36:49.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.split_metrics run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status success for try_number 1 2024-07-04T01:36:49.556106536Z [2024-07-04T01:36:49.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=split_metrics, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=-1, run_start_date=2024-07-04 01:36:48.464427+00:00, run_end_date=2024-07-04 01:36:48.875063+00:00, run_duration=0.410636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:36:46.518705+00:00, queued_by_job_id=2, pid=927 2024-07-04T01:36:49.556380551Z [2024-07-04T01:36:49.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 424b30ef-c8ee-440e-9e4c-6caed11c602a 2024-07-04T01:36:52.899517723Z [2024-07-04T01:36:52.899+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:36:52.899537067Z 2024-07-04T01:36:52.900109104Z [2024-07-04T01:36:52.899+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:36:52.900831037Z [2024-07-04T01:36:52.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:36:52.900842459Z 2024-07-04T01:36:52.903178614Z [2024-07-04T01:36:52.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='send_prometheus', run_id='scheduled__2024-07-04T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:36:52.903451505Z [2024-07-04T01:36:52.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'send_prometheus', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:36:52.957963292Z [2024-07-04T01:36:52.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.send_prometheus run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status queued for try_number 1 2024-07-04T01:36:52.960982888Z [2024-07-04T01:36:52.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.collect_metrics run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status success for try_number 1 2024-07-04T01:36:52.971762894Z [2024-07-04T01:36:52.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=collect_metrics, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=0, run_start_date=2024-07-04 01:36:51.540720+00:00, run_end_date=2024-07-04 01:36:51.868212+00:00, run_duration=0.327492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:36:49.427454+00:00, queued_by_job_id=2, pid=939 2024-07-04T01:36:52.973277566Z [2024-07-04T01:36:52.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec93bf76-acac-42ae-bf75-303455a005e9 2024-07-04T01:36:55.760329775Z [2024-07-04T01:36:55.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:36:55.760738637Z [2024-07-04T01:36:55.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:30:00+00:00, run_id=scheduled__2024-07-04T01:30:00+00:00, run_start_date=2024-07-04 01:36:42.969305+00:00, run_end_date=2024-07-04 01:36:55.760208+00:00, run_duration=12.790903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:30:00+00:00, data_interval_end=2024-07-04 01:35:00+00:00, dag_hash=fe3b9591aaaf627bb760a9fa5889ca7b 2024-07-04T01:36:55.767191799Z [2024-07-04T01:36:55.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:35:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:36:55.802470570Z [2024-07-04T01:36:55.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.send_prometheus run_id=scheduled__2024-07-04T01:30:00+00:00 exited with status success for try_number 1 2024-07-04T01:36:55.808038768Z [2024-07-04T01:36:55.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=send_prometheus, run_id=scheduled__2024-07-04T01:30:00+00:00, map_index=-1, run_start_date=2024-07-04 01:36:54.970648+00:00, run_end_date=2024-07-04 01:36:55.429648+00:00, run_duration=0.459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:36:52.901260+00:00, queued_by_job_id=2, pid=961 2024-07-04T01:37:00.883562120Z [2024-07-04T01:37:00.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:37:00+00:00, run_after=2024-07-04T01:38:00+00:00 2024-07-04T01:37:00.896425863Z [2024-07-04T01:37:00.896+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:37:00.906174730Z [2024-07-04T01:37:00.905+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:37:00.921134799Z [2024-07-04T01:37:00.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:37:00+00:00, run_after=2024-07-04T01:38:00+00:00 2024-07-04T01:37:01.071930591Z [2024-07-04T01:37:01.071+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T01:37:01.071957025Z 2024-07-04T01:37:01.071963046Z 2024-07-04T01:37:01.071968761Z 2024-07-04T01:37:01.071973372Z 2024-07-04T01:37:01.072114759Z [2024-07-04T01:37:01.071+0000] {scheduler_job.py:425} INFO - DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:37:01.072258184Z [2024-07-04T01:37:01.072+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:37:01.072382002Z [2024-07-04T01:37:01.072+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:37:01.072503959Z [2024-07-04T01:37:01.072+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:37:01.073134875Z [2024-07-04T01:37:01.072+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:37:01.073149210Z 2024-07-04T01:37:01.073152653Z 2024-07-04T01:37:01.073155834Z 2024-07-04T01:37:01.073159102Z 2024-07-04T01:37:01.077743866Z [2024-07-04T01:37:01.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:37:01.077996014Z [2024-07-04T01:37:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:37:01.078336240Z [2024-07-04T01:37:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:37:01.078548305Z [2024-07-04T01:37:01.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:37:01.078839810Z [2024-07-04T01:37:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:37:01.079098928Z [2024-07-04T01:37:01.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:37:01.079333469Z [2024-07-04T01:37:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:37:01.079439659Z [2024-07-04T01:37:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:37:01.648023109Z [2024-07-04T01:37:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status queued for try_number 1 2024-07-04T01:37:01.648210328Z [2024-07-04T01:37:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status queued for try_number 1 2024-07-04T01:37:01.648343038Z [2024-07-04T01:37:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status queued for try_number 1 2024-07-04T01:37:01.648475436Z [2024-07-04T01:37:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status queued for try_number 1 2024-07-04T01:37:01.668595750Z [2024-07-04T01:37:01.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 335df0e5-7404-4e0d-b1eb-0c2638b331e6 2024-07-04T01:37:01.668824735Z [2024-07-04T01:37:01.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a575d64-cc5a-444c-9db4-05c4ba3708e3 2024-07-04T01:37:01.668997670Z [2024-07-04T01:37:01.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dccaf4a-aeed-4aca-8c61-5b3e0b4f225f 2024-07-04T01:37:01.669282512Z [2024-07-04T01:37:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58739443-e593-490b-8913-671ac7b87783 2024-07-04T01:37:06.044896936Z [2024-07-04T01:37:06.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:37:06.045095220Z [2024-07-04T01:37:06.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:36:00+00:00, run_id=scheduled__2024-07-04T01:36:00+00:00, run_start_date=2024-07-04 01:37:00.942789+00:00, run_end_date=2024-07-04 01:37:06.044756+00:00, run_duration=5.101967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:36:00+00:00, data_interval_end=2024-07-04 01:37:00+00:00, dag_hash=b7541a35136af9db48a9f03e98535b6f 2024-07-04T01:37:06.055356647Z [2024-07-04T01:37:06.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:37:00+00:00, run_after=2024-07-04T01:38:00+00:00 2024-07-04T01:37:06.066793693Z [2024-07-04T01:37:06.061+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:37:06.066815062Z [2024-07-04T01:37:06.062+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:36:00+00:00, run_id=scheduled__2024-07-04T01:36:00+00:00, run_start_date=2024-07-04 01:37:00.954521+00:00, run_end_date=2024-07-04 01:37:06.061974+00:00, run_duration=5.107453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:36:00+00:00, data_interval_end=2024-07-04 01:37:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:37:06.077123527Z [2024-07-04T01:37:06.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:37:00+00:00, run_after=2024-07-04T01:38:00+00:00 2024-07-04T01:37:06.112997091Z [2024-07-04T01:37:06.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status success for try_number 1 2024-07-04T01:37:06.113032639Z [2024-07-04T01:37:06.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status success for try_number 1 2024-07-04T01:37:06.113079600Z [2024-07-04T01:37:06.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status success for try_number 1 2024-07-04T01:37:06.120777354Z [2024-07-04T01:37:06.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:36:00+00:00, map_index=-1, run_start_date=2024-07-04 01:37:03.666150+00:00, run_end_date=2024-07-04 01:37:05.193806+00:00, run_duration=1.527656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:37:01.074516+00:00, queued_by_job_id=2, pid=1010 2024-07-04T01:37:06.120946803Z [2024-07-04T01:37:06.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:36:00+00:00, map_index=-1, run_start_date=2024-07-04 01:37:03.688721+00:00, run_end_date=2024-07-04 01:37:05.347415+00:00, run_duration=1.658694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:37:01.074516+00:00, queued_by_job_id=2, pid=1011 2024-07-04T01:37:06.121057031Z [2024-07-04T01:37:06.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:36:00+00:00, map_index=-1, run_start_date=2024-07-04 01:37:03.635856+00:00, run_end_date=2024-07-04 01:37:05.964377+00:00, run_duration=2.328521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:37:01.074516+00:00, queued_by_job_id=2, pid=1009 2024-07-04T01:37:06.761971381Z [2024-07-04T01:37:06.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:37:06.762209925Z [2024-07-04T01:37:06.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:36:00+00:00, run_id=scheduled__2024-07-04T01:36:00+00:00, run_start_date=2024-07-04 01:37:00.944488+00:00, run_end_date=2024-07-04 01:37:06.761916+00:00, run_duration=5.817428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:36:00+00:00, data_interval_end=2024-07-04 01:37:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:37:06.776681777Z [2024-07-04T01:37:06.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:37:00+00:00, run_after=2024-07-04T01:38:00+00:00 2024-07-04T01:37:06.784063913Z [2024-07-04T01:37:06.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:37:06.784163952Z [2024-07-04T01:37:06.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:36:00+00:00, run_id=scheduled__2024-07-04T01:36:00+00:00, run_start_date=2024-07-04 01:37:00.949139+00:00, run_end_date=2024-07-04 01:37:06.783903+00:00, run_duration=5.834764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:36:00+00:00, data_interval_end=2024-07-04 01:37:00+00:00, dag_hash=3bc69dfe47ffd351686f168b6171ee80 2024-07-04T01:37:06.794198280Z [2024-07-04T01:37:06.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:37:00+00:00, run_after=2024-07-04T01:38:00+00:00 2024-07-04T01:37:06.841653957Z [2024-07-04T01:37:06.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status success for try_number 1 2024-07-04T01:37:06.848300547Z [2024-07-04T01:37:06.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:36:00+00:00, map_index=-1, run_start_date=2024-07-04 01:37:03.861308+00:00, run_end_date=2024-07-04 01:37:06.188091+00:00, run_duration=2.326783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:37:01.074516+00:00, queued_by_job_id=2, pid=1012 2024-07-04T01:38:00.401869491Z [2024-07-04T01:38:00.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:38:00+00:00, run_after=2024-07-04T01:39:00+00:00 2024-07-04T01:38:00.411657707Z [2024-07-04T01:38:00.411+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:38:00.418835826Z [2024-07-04T01:38:00.418+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:38:00.427429471Z [2024-07-04T01:38:00.427+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:38:00.449250817Z [2024-07-04T01:38:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:38:00+00:00, run_after=2024-07-04T01:39:00+00:00 2024-07-04T01:38:00.578361523Z [2024-07-04T01:38:00.578+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-07-04T01:38:00.578377708Z 2024-07-04T01:38:00.578383994Z 2024-07-04T01:38:00.578387422Z 2024-07-04T01:38:00.578398048Z 2024-07-04T01:38:00.578401470Z 2024-07-04T01:38:00.578642448Z [2024-07-04T01:38:00.578+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:38:00.578854867Z [2024-07-04T01:38:00.578+0000] {scheduler_job.py:425} INFO - DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:38:00.579051200Z [2024-07-04T01:38:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:38:00.579220454Z [2024-07-04T01:38:00.579+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:38:00.579355928Z [2024-07-04T01:38:00.579+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:38:00.580050973Z [2024-07-04T01:38:00.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:38:00.580062489Z 2024-07-04T01:38:00.580066290Z 2024-07-04T01:38:00.580069498Z 2024-07-04T01:38:00.580072891Z 2024-07-04T01:38:00.580076460Z 2024-07-04T01:38:00.587278664Z [2024-07-04T01:38:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:38:00.587594022Z [2024-07-04T01:38:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:38:00.588017618Z [2024-07-04T01:38:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:38:00.588280510Z [2024-07-04T01:38:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:38:00.588630890Z [2024-07-04T01:38:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:38:00.588910287Z [2024-07-04T01:38:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:38:00.589207178Z [2024-07-04T01:38:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:38:00.589377204Z [2024-07-04T01:38:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:38:00.589697211Z [2024-07-04T01:38:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:38:00.589872310Z [2024-07-04T01:38:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:38:01.115219733Z [2024-07-04T01:38:01.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status queued for try_number 1 2024-07-04T01:38:01.117103639Z [2024-07-04T01:38:01.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:37:00+00:00 exited with status queued for try_number 1 2024-07-04T01:38:01.117260315Z [2024-07-04T01:38:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:37:00+00:00 exited with status queued for try_number 1 2024-07-04T01:38:01.117625696Z [2024-07-04T01:38:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:37:00+00:00 exited with status queued for try_number 1 2024-07-04T01:38:01.118327752Z [2024-07-04T01:38:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:37:00+00:00 exited with status queued for try_number 1 2024-07-04T01:38:01.138196356Z [2024-07-04T01:38:01.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24a74bc8-63ce-416c-9798-46ad3aac9723 2024-07-04T01:38:01.138847502Z [2024-07-04T01:38:01.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee43f028-31d1-4a1d-b6d9-192d3266df3b 2024-07-04T01:38:01.139068998Z [2024-07-04T01:38:01.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to 050f9de7-6e36-406e-9ea2-21b2869d6c4b 2024-07-04T01:38:01.139171712Z [2024-07-04T01:38:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2879cdd-493c-441d-b113-8546821a5b7c 2024-07-04T01:38:01.140606641Z [2024-07-04T01:38:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to b19c6203-3c82-43ae-8848-2ff336a5e6da 2024-07-04T01:38:03.832953872Z [2024-07-04T01:38:03.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:38:03.833317349Z [2024-07-04T01:38:03.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:36:00+00:00, run_id=scheduled__2024-07-04T01:36:00+00:00, run_start_date=2024-07-04 01:38:00.470159+00:00, run_end_date=2024-07-04 01:38:03.832873+00:00, run_duration=3.362714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:36:00+00:00, data_interval_end=2024-07-04 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:38:03.858897889Z [2024-07-04T01:38:03.858+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:38:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:38:03.993053459Z [2024-07-04T01:38:03.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:36:00+00:00 exited with status success for try_number 1 2024-07-04T01:38:04.000388211Z [2024-07-04T01:38:04.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:36:00+00:00, map_index=-1, run_start_date=2024-07-04 01:38:02.043169+00:00, run_end_date=2024-07-04 01:38:02.925999+00:00, run_duration=0.88283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:38:00.581156+00:00, queued_by_job_id=2, pid=1067 2024-07-04T01:38:07.217481032Z [2024-07-04T01:38:07.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:38:07.217704863Z [2024-07-04T01:38:07.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:37:00+00:00, run_id=scheduled__2024-07-04T01:37:00+00:00, run_start_date=2024-07-04 01:38:00.471762+00:00, run_end_date=2024-07-04 01:38:07.217425+00:00, run_duration=6.745663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:37:00+00:00, data_interval_end=2024-07-04 01:38:00+00:00, dag_hash=b7541a35136af9db48a9f03e98535b6f 2024-07-04T01:38:07.226355568Z [2024-07-04T01:38:07.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:38:00+00:00, run_after=2024-07-04T01:39:00+00:00 2024-07-04T01:38:07.234229080Z [2024-07-04T01:38:07.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:38:07.234348635Z [2024-07-04T01:38:07.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:37:00+00:00, run_id=scheduled__2024-07-04T01:37:00+00:00, run_start_date=2024-07-04 01:38:00.476414+00:00, run_end_date=2024-07-04 01:38:07.234091+00:00, run_duration=6.757677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:37:00+00:00, data_interval_end=2024-07-04 01:38:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:38:07.243927814Z [2024-07-04T01:38:07.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:38:00+00:00, run_after=2024-07-04T01:39:00+00:00 2024-07-04T01:38:07.309493798Z [2024-07-04T01:38:07.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:37:00+00:00 exited with status success for try_number 1 2024-07-04T01:38:07.310922471Z [2024-07-04T01:38:07.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:37:00+00:00 exited with status success for try_number 1 2024-07-04T01:38:07.322628265Z [2024-07-04T01:38:07.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:37:00+00:00, map_index=-1, run_start_date=2024-07-04 01:38:04.336535+00:00, run_end_date=2024-07-04 01:38:06.305123+00:00, run_duration=1.968588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:38:00.581156+00:00, queued_by_job_id=2, pid=1119 2024-07-04T01:38:07.323565029Z [2024-07-04T01:38:07.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:37:00+00:00, map_index=-1, run_start_date=2024-07-04 01:38:04.165097+00:00, run_end_date=2024-07-04 01:38:06.640777+00:00, run_duration=2.47568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:38:00.581156+00:00, queued_by_job_id=2, pid=1113 2024-07-04T01:38:08.399763852Z [2024-07-04T01:38:08.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:38:08.400055546Z [2024-07-04T01:38:08.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:37:00+00:00, run_id=scheduled__2024-07-04T01:37:00+00:00, run_start_date=2024-07-04 01:38:00.474127+00:00, run_end_date=2024-07-04 01:38:08.399654+00:00, run_duration=7.925527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:37:00+00:00, data_interval_end=2024-07-04 01:38:00+00:00, dag_hash=3bc69dfe47ffd351686f168b6171ee80 2024-07-04T01:38:08.410159730Z [2024-07-04T01:38:08.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:38:00+00:00, run_after=2024-07-04T01:39:00+00:00 2024-07-04T01:38:08.419048199Z [2024-07-04T01:38:08.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:38:08.419371806Z [2024-07-04T01:38:08.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:37:00+00:00, run_id=scheduled__2024-07-04T01:37:00+00:00, run_start_date=2024-07-04 01:38:00.472906+00:00, run_end_date=2024-07-04 01:38:08.418851+00:00, run_duration=7.945945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:37:00+00:00, data_interval_end=2024-07-04 01:38:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:38:08.437233371Z [2024-07-04T01:38:08.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:38:00+00:00, run_after=2024-07-04T01:39:00+00:00 2024-07-04T01:38:08.470548708Z [2024-07-04T01:38:08.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:37:00+00:00 exited with status success for try_number 1 2024-07-04T01:38:08.470601816Z [2024-07-04T01:38:08.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:37:00+00:00 exited with status success for try_number 1 2024-07-04T01:38:08.485366946Z [2024-07-04T01:38:08.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:37:00+00:00, map_index=-1, run_start_date=2024-07-04 01:38:04.629983+00:00, run_end_date=2024-07-04 01:38:07.424717+00:00, run_duration=2.794734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:38:00.581156+00:00, queued_by_job_id=2, pid=1129 2024-07-04T01:38:08.485999607Z [2024-07-04T01:38:08.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:37:00+00:00, map_index=-1, run_start_date=2024-07-04 01:38:04.111867+00:00, run_end_date=2024-07-04 01:38:07.439335+00:00, run_duration=3.327468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:38:00.581156+00:00, queued_by_job_id=2, pid=1112 2024-07-04T01:39:00.814436477Z [2024-07-04T01:39:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:39:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:39:00.825769422Z [2024-07-04T01:39:00.825+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:39:00.839754361Z [2024-07-04T01:39:00.839+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:39:00.854378925Z [2024-07-04T01:39:00.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:39:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:39:00.956915747Z [2024-07-04T01:39:00.956+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T01:39:00.956930147Z 2024-07-04T01:39:00.956933249Z 2024-07-04T01:39:00.956936481Z 2024-07-04T01:39:00.956943655Z 2024-07-04T01:39:00.957102456Z [2024-07-04T01:39:00.956+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:39:00.957246278Z [2024-07-04T01:39:00.957+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:39:00.957354096Z [2024-07-04T01:39:00.957+0000] {scheduler_job.py:425} INFO - DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:39:00.957509633Z [2024-07-04T01:39:00.957+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:39:00.959149750Z [2024-07-04T01:39:00.958+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:39:00.959171810Z 2024-07-04T01:39:00.959175343Z 2024-07-04T01:39:00.959178410Z 2024-07-04T01:39:00.959181422Z 2024-07-04T01:39:00.962862821Z [2024-07-04T01:39:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:39:00.963010766Z [2024-07-04T01:39:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:39:00.963182555Z [2024-07-04T01:39:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:39:00.963244549Z [2024-07-04T01:39:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:39:00.963458212Z [2024-07-04T01:39:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:39:00.963594782Z [2024-07-04T01:39:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:39:00.963815683Z [2024-07-04T01:39:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:39:00.963929056Z [2024-07-04T01:39:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:39:01.413266233Z [2024-07-04T01:39:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status queued for try_number 1 2024-07-04T01:39:01.415414212Z [2024-07-04T01:39:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status queued for try_number 1 2024-07-04T01:39:01.419602427Z [2024-07-04T01:39:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status queued for try_number 1 2024-07-04T01:39:01.421943969Z [2024-07-04T01:39:01.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status queued for try_number 1 2024-07-04T01:39:01.441975289Z [2024-07-04T01:39:01.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to d39eab6c-9e9a-4050-9448-e10332e9edbd 2024-07-04T01:39:01.442274920Z [2024-07-04T01:39:01.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcafc2c2-264c-4096-a1ea-31d0e7d75196 2024-07-04T01:39:01.442469854Z [2024-07-04T01:39:01.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8839edda-52e1-4e18-9646-cdc33f91aab0 2024-07-04T01:39:01.442684352Z [2024-07-04T01:39:01.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 670a0784-2e72-4d11-9f1f-8a18751fabb4 2024-07-04T01:39:05.669145558Z [2024-07-04T01:39:05.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:39:05.669643454Z [2024-07-04T01:39:05.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:38:00+00:00, run_id=scheduled__2024-07-04T01:38:00+00:00, run_start_date=2024-07-04 01:39:00.885471+00:00, run_end_date=2024-07-04 01:39:05.669014+00:00, run_duration=4.783543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:38:00+00:00, data_interval_end=2024-07-04 01:39:00+00:00, dag_hash=b7541a35136af9db48a9f03e98535b6f 2024-07-04T01:39:05.681716999Z [2024-07-04T01:39:05.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:39:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:39:05.778107562Z [2024-07-04T01:39:05.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status success for try_number 1 2024-07-04T01:39:05.786809119Z [2024-07-04T01:39:05.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:38:00+00:00, map_index=-1, run_start_date=2024-07-04 01:39:03.717954+00:00, run_end_date=2024-07-04 01:39:05.322182+00:00, run_duration=1.604228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:39:00.960012+00:00, queued_by_job_id=2, pid=1187 2024-07-04T01:39:06.839131020Z [2024-07-04T01:39:06.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:39:06.839591260Z [2024-07-04T01:39:06.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:38:00+00:00, run_id=scheduled__2024-07-04T01:38:00+00:00, run_start_date=2024-07-04 01:39:00.887896+00:00, run_end_date=2024-07-04 01:39:06.839030+00:00, run_duration=5.951134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:38:00+00:00, data_interval_end=2024-07-04 01:39:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:39:06.854176292Z [2024-07-04T01:39:06.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:39:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:39:06.865302123Z [2024-07-04T01:39:06.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:39:06.867339361Z [2024-07-04T01:39:06.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:38:00+00:00, run_id=scheduled__2024-07-04T01:38:00+00:00, run_start_date=2024-07-04 01:39:00.880577+00:00, run_end_date=2024-07-04 01:39:06.866723+00:00, run_duration=5.986146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:38:00+00:00, data_interval_end=2024-07-04 01:39:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:39:06.879644507Z [2024-07-04T01:39:06.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:39:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:39:06.888064454Z [2024-07-04T01:39:06.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:39:06.888329428Z [2024-07-04T01:39:06.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:38:00+00:00, run_id=scheduled__2024-07-04T01:38:00+00:00, run_start_date=2024-07-04 01:39:00.882967+00:00, run_end_date=2024-07-04 01:39:06.888017+00:00, run_duration=6.00505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:38:00+00:00, data_interval_end=2024-07-04 01:39:00+00:00, dag_hash=3bc69dfe47ffd351686f168b6171ee80 2024-07-04T01:39:06.899319044Z [2024-07-04T01:39:06.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:39:00+00:00, run_after=2024-07-04T01:40:00+00:00 2024-07-04T01:39:06.943407108Z [2024-07-04T01:39:06.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status success for try_number 1 2024-07-04T01:39:06.943608533Z [2024-07-04T01:39:06.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status success for try_number 1 2024-07-04T01:39:06.943772701Z [2024-07-04T01:39:06.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status success for try_number 1 2024-07-04T01:39:06.954672608Z [2024-07-04T01:39:06.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:38:00+00:00, map_index=-1, run_start_date=2024-07-04 01:39:04.666367+00:00, run_end_date=2024-07-04 01:39:06.079418+00:00, run_duration=1.413051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:39:00.960012+00:00, queued_by_job_id=2, pid=1225 2024-07-04T01:39:06.955127297Z [2024-07-04T01:39:06.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:38:00+00:00, map_index=-1, run_start_date=2024-07-04 01:39:04.391351+00:00, run_end_date=2024-07-04 01:39:06.255071+00:00, run_duration=1.86372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:39:00.960012+00:00, queued_by_job_id=2, pid=1215 2024-07-04T01:39:06.955457782Z [2024-07-04T01:39:06.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:38:00+00:00, map_index=-1, run_start_date=2024-07-04 01:39:04.832199+00:00, run_end_date=2024-07-04 01:39:06.520628+00:00, run_duration=1.688429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:39:00.960012+00:00, queued_by_job_id=2, pid=1226 2024-07-04T01:40:00.313852978Z [2024-07-04T01:40:00.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:41:00+00:00 2024-07-04T01:40:00.324151920Z [2024-07-04T01:40:00.323+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:40:00.348840061Z [2024-07-04T01:40:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:45:00+00:00 2024-07-04T01:40:00.363534754Z [2024-07-04T01:40:00.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:41:00+00:00 2024-07-04T01:40:00.371771059Z [2024-07-04T01:40:00.371+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:40:00.385925920Z [2024-07-04T01:40:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:45:00+00:00 2024-07-04T01:40:00.394801005Z [2024-07-04T01:40:00.394+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:40:00.571472542Z [2024-07-04T01:40:00.571+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-07-04T01:40:00.571488128Z 2024-07-04T01:40:00.571504762Z 2024-07-04T01:40:00.571513006Z 2024-07-04T01:40:00.571516751Z 2024-07-04T01:40:00.571520068Z 2024-07-04T01:40:00.571523190Z 2024-07-04T01:40:00.571526282Z 2024-07-04T01:40:00.573320804Z [2024-07-04T01:40:00.571+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:40:00.574233955Z [2024-07-04T01:40:00.573+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:40:00.574848065Z [2024-07-04T01:40:00.574+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:40:00.575353625Z [2024-07-04T01:40:00.574+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:40:00.575967739Z [2024-07-04T01:40:00.575+0000] {scheduler_job.py:425} INFO - DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:40:00.576305912Z [2024-07-04T01:40:00.576+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:40:00.576570801Z [2024-07-04T01:40:00.576+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:40:00.578226522Z [2024-07-04T01:40:00.577+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:40:00.578237868Z 2024-07-04T01:40:00.578241383Z 2024-07-04T01:40:00.578244983Z 2024-07-04T01:40:00.578248784Z 2024-07-04T01:40:00.578251863Z 2024-07-04T01:40:00.578255288Z 2024-07-04T01:40:00.578258405Z 2024-07-04T01:40:00.592424651Z [2024-07-04T01:40:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:40:00.592523053Z [2024-07-04T01:40:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:00.592716009Z [2024-07-04T01:40:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:40:00.592799985Z [2024-07-04T01:40:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:00.592960700Z [2024-07-04T01:40:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:40:00.593031677Z [2024-07-04T01:40:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:40:00.593182542Z [2024-07-04T01:40:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:40:00.593255592Z [2024-07-04T01:40:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:40:00.593437201Z [2024-07-04T01:40:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:40:00.593506093Z [2024-07-04T01:40:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:40:00.593667086Z [2024-07-04T01:40:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:40:00.593753245Z [2024-07-04T01:40:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:40:00.593893295Z [2024-07-04T01:40:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:40:00.593968451Z [2024-07-04T01:40:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:40:01.540830087Z [2024-07-04T01:40:01.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:01.540974469Z [2024-07-04T01:40:01.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:01.541107003Z [2024-07-04T01:40:01.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:01.541243494Z [2024-07-04T01:40:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:01.541376155Z [2024-07-04T01:40:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:01.541500666Z [2024-07-04T01:40:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:01.541618336Z [2024-07-04T01:40:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:01.557788486Z [2024-07-04T01:40:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a691f86-fcff-47a9-8ddf-ae23b4568315 2024-07-04T01:40:01.557995159Z [2024-07-04T01:40:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7efe4b2d-b26c-42b6-9c7a-edec26c09249 2024-07-04T01:40:01.558171446Z [2024-07-04T01:40:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81c21e0e-8fa6-4cef-8101-d41199b33adf 2024-07-04T01:40:01.558343887Z [2024-07-04T01:40:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 709986c5-86da-43cb-9b55-3a0be217bf77 2024-07-04T01:40:01.558506153Z [2024-07-04T01:40:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a204d2a-854b-42a2-ab52-20c8d02c1895 2024-07-04T01:40:01.558705609Z [2024-07-04T01:40:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to eab25642-faaa-4253-9776-63ed40001148 2024-07-04T01:40:01.558929862Z [2024-07-04T01:40:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3599ece-2398-4d86-b957-fea89ce78194 2024-07-04T01:40:04.583727679Z [2024-07-04T01:40:04.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:40:04.584174607Z [2024-07-04T01:40:04.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:38:00+00:00, run_id=scheduled__2024-07-04T01:38:00+00:00, run_start_date=2024-07-04 01:40:00.409688+00:00, run_end_date=2024-07-04 01:40:04.583809+00:00, run_duration=4.174121, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:38:00+00:00, data_interval_end=2024-07-04 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:40:04.606432255Z [2024-07-04T01:40:04.606+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:42:00+00:00 2024-07-04T01:40:04.795472349Z [2024-07-04T01:40:04.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status failed for try_number 1 2024-07-04T01:40:04.795938559Z [2024-07-04T01:40:04.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:38:00+00:00 exited with status success for try_number 1 2024-07-04T01:40:04.815489914Z [2024-07-04T01:40:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:38:00+00:00, map_index=-1, run_start_date=2024-07-04 01:40:02.641020+00:00, run_end_date=2024-07-04 01:40:03.885888+00:00, run_duration=1.244868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:00.580311+00:00, queued_by_job_id=2, pid=1275 2024-07-04T01:40:04.816049521Z [2024-07-04T01:40:04.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:00.580311+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:40:04.816914987Z [2024-07-04T01:40:04.816+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:04.823927061Z [2024-07-04T01:40:04.823+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:04.849038649Z [2024-07-04T01:40:04.848+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=extract_metrics_from_vnfrs, execution_date=20240704T013500, start_date=, end_date=20240704T014004 2024-07-04T01:40:06.045597076Z [2024-07-04T01:40:06.044+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:40:06.045658482Z 2024-07-04T01:40:06.046575429Z [2024-07-04T01:40:06.045+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:40:06.047560389Z [2024-07-04T01:40:06.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:40:06.047576990Z 2024-07-04T01:40:06.051586675Z [2024-07-04T01:40:06.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T01:40:06.051857904Z [2024-07-04T01:40:06.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:06.126683703Z [2024-07-04T01:40:06.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:06.127156487Z [2024-07-04T01:40:06.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status success for try_number 1 2024-07-04T01:40:06.127269598Z [2024-07-04T01:40:06.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status failed for try_number 1 2024-07-04T01:40:06.127367824Z [2024-07-04T01:40:06.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status failed for try_number 1 2024-07-04T01:40:06.141584751Z [2024-07-04T01:40:06.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=-1, run_start_date=2024-07-04 01:40:04.677919+00:00, run_end_date=2024-07-04 01:40:05.190739+00:00, run_duration=0.51282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:00.580311+00:00, queued_by_job_id=2, pid=1328 2024-07-04T01:40:06.141811480Z [2024-07-04T01:40:06.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38ef7b7a-7dca-46c0-ac62-3bf7feb400ca 2024-07-04T01:40:06.141943013Z [2024-07-04T01:40:06.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:00.580311+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:40:06.142392094Z [2024-07-04T01:40:06.142+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:06.146124344Z [2024-07-04T01:40:06.145+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:06.159396873Z [2024-07-04T01:40:06.159+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T013900, start_date=, end_date=20240704T014006 2024-07-04T01:40:06.168482920Z [2024-07-04T01:40:06.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:00.580311+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:40:06.168956126Z [2024-07-04T01:40:06.168+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:06.171586025Z [2024-07-04T01:40:06.171+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:06.185213043Z [2024-07-04T01:40:06.184+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T013900, start_date=, end_date=20240704T014006 2024-07-04T01:40:07.460204992Z [2024-07-04T01:40:07.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:40:07.460549307Z [2024-07-04T01:40:07.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:39:00+00:00, run_id=scheduled__2024-07-04T01:39:00+00:00, run_start_date=2024-07-04 01:40:00.411403+00:00, run_end_date=2024-07-04 01:40:07.460233+00:00, run_duration=7.04883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:39:00+00:00, data_interval_end=2024-07-04 01:40:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:40:07.471207730Z [2024-07-04T01:40:07.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:41:00+00:00 2024-07-04T01:40:07.486835151Z [2024-07-04T01:40:07.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:40:07.487280592Z [2024-07-04T01:40:07.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:39:00+00:00, run_id=scheduled__2024-07-04T01:39:00+00:00, run_start_date=2024-07-04 01:40:00.415229+00:00, run_end_date=2024-07-04 01:40:07.486828+00:00, run_duration=7.071599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:39:00+00:00, data_interval_end=2024-07-04 01:40:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:40:07.500144609Z [2024-07-04T01:40:07.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:41:00+00:00 2024-07-04T01:40:07.603047998Z [2024-07-04T01:40:07.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status success for try_number 1 2024-07-04T01:40:07.603216445Z [2024-07-04T01:40:07.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status success for try_number 1 2024-07-04T01:40:07.611507121Z [2024-07-04T01:40:07.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:39:00+00:00, map_index=-1, run_start_date=2024-07-04 01:40:05.025432+00:00, run_end_date=2024-07-04 01:40:06.647936+00:00, run_duration=1.622504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:00.580311+00:00, queued_by_job_id=2, pid=1363 2024-07-04T01:40:07.611769801Z [2024-07-04T01:40:07.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:39:00+00:00, map_index=-1, run_start_date=2024-07-04 01:40:05.576634+00:00, run_end_date=2024-07-04 01:40:06.883139+00:00, run_duration=1.306505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:00.580311+00:00, queued_by_job_id=2, pid=1391 2024-07-04T01:40:08.387711303Z [2024-07-04T01:40:08.387+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:40:08.387751776Z 2024-07-04T01:40:08.387887968Z [2024-07-04T01:40:08.387+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:40:08.388642327Z [2024-07-04T01:40:08.388+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:40:08.388658728Z 2024-07-04T01:40:08.393082180Z [2024-07-04T01:40:08.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T01:40:08.393419253Z [2024-07-04T01:40:08.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:40:08.483191508Z [2024-07-04T01:40:08.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:08.483510145Z [2024-07-04T01:40:08.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status success for try_number 1 2024-07-04T01:40:08.491580533Z [2024-07-04T01:40:08.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=-1, run_start_date=2024-07-04 01:40:07.798945+00:00, run_end_date=2024-07-04 01:40:08.179712+00:00, run_duration=0.380767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:06.048051+00:00, queued_by_job_id=2, pid=1412 2024-07-04T01:40:08.492026072Z [2024-07-04T01:40:08.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to d173338e-9c3c-4559-a9e8-1e4fea0da4c8 2024-07-04T01:40:10.986105036Z [2024-07-04T01:40:10.985+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:40:10.986180856Z 2024-07-04T01:40:10.986196951Z [2024-07-04T01:40:10.985+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:40:10.986615061Z [2024-07-04T01:40:10.986+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:40:10.986660354Z 2024-07-04T01:40:10.989203580Z [2024-07-04T01:40:10.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:40:10.989278044Z [2024-07-04T01:40:10.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:11.053374693Z [2024-07-04T01:40:11.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 1 2024-07-04T01:40:11.053406331Z [2024-07-04T01:40:11.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status success for try_number 1 2024-07-04T01:40:11.059989805Z [2024-07-04T01:40:11.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=0, run_start_date=2024-07-04 01:40:10.101371+00:00, run_end_date=2024-07-04 01:40:10.499912+00:00, run_duration=0.398541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:08.389107+00:00, queued_by_job_id=2, pid=1424 2024-07-04T01:40:11.060859883Z [2024-07-04T01:40:11.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78a8595b-a5a5-4538-b0fa-7e1a6bbcaae7 2024-07-04T01:40:13.377821113Z [2024-07-04T01:40:13.377+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:40:13.378183698Z [2024-07-04T01:40:13.377+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:35:00+00:00, run_id=scheduled__2024-07-04T01:35:00+00:00, run_start_date=2024-07-04 01:40:00.405191+00:00, run_end_date=2024-07-04 01:40:13.377674+00:00, run_duration=12.972483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:35:00+00:00, data_interval_end=2024-07-04 01:40:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T01:40:13.386792807Z [2024-07-04T01:40:13.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:45:00+00:00 2024-07-04T01:40:13.666772869Z [2024-07-04T01:40:13.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status success for try_number 1 2024-07-04T01:40:13.675774934Z [2024-07-04T01:40:13.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=-1, run_start_date=2024-07-04 01:40:12.864527+00:00, run_end_date=2024-07-04 01:40:13.310630+00:00, run_duration=0.446103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:10.986833+00:00, queued_by_job_id=2, pid=1436 2024-07-04T01:40:15.921503985Z [2024-07-04T01:40:15.920+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:40:15.921553715Z 2024-07-04T01:40:15.921564431Z [2024-07-04T01:40:15.921+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:40:15.922062300Z [2024-07-04T01:40:15.921+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:40:15.922163299Z 2024-07-04T01:40:15.931497144Z [2024-07-04T01:40:15.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:35:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:40:15.931853099Z [2024-07-04T01:40:15.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:16.024040464Z [2024-07-04T01:40:16.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status queued for try_number 2 2024-07-04T01:40:16.031950993Z [2024-07-04T01:40:16.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1361a37-8332-4c38-ba34-824f0f2e9c1d 2024-07-04T01:40:17.223174874Z [2024-07-04T01:40:17.222+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:40:17.223230119Z 2024-07-04T01:40:17.223240753Z 2024-07-04T01:40:17.223438730Z [2024-07-04T01:40:17.222+0000] {scheduler_job.py:425} INFO - DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:40:17.223452533Z [2024-07-04T01:40:17.223+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:40:17.223751112Z [2024-07-04T01:40:17.223+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:40:17.223783914Z 2024-07-04T01:40:17.223793687Z 2024-07-04T01:40:17.234378410Z [2024-07-04T01:40:17.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:40:17.235562899Z [2024-07-04T01:40:17.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:40:17.238402372Z [2024-07-04T01:40:17.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:40:17.239539897Z [2024-07-04T01:40:17.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:40:17.516664430Z [2024-07-04T01:40:17.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status queued for try_number 2 2024-07-04T01:40:17.516901369Z [2024-07-04T01:40:17.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status queued for try_number 2 2024-07-04T01:40:17.525754632Z [2024-07-04T01:40:17.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5800e8ec-eb8f-4be2-a701-da8e457cfddf 2024-07-04T01:40:17.526138688Z [2024-07-04T01:40:17.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 247de432-e68b-44e0-a3a4-b07774c70fc1 2024-07-04T01:40:18.749669621Z [2024-07-04T01:40:18.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:35:00+00:00 exited with status failed for try_number 2 2024-07-04T01:40:18.774827627Z [2024-07-04T01:40:18.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:40:04.829401+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:15.923944+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:40:18.775968481Z [2024-07-04T01:40:18.775+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:18.779285780Z [2024-07-04T01:40:18.778+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:18.805300221Z [2024-07-04T01:40:18.804+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=extract_metrics_from_vnfrs, execution_date=20240704T013500, start_date=, end_date=20240704T014018 2024-07-04T01:40:20.053054590Z [2024-07-04T01:40:20.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status failed for try_number 2 2024-07-04T01:40:20.055874010Z [2024-07-04T01:40:20.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:39:00+00:00 exited with status failed for try_number 2 2024-07-04T01:40:20.075806010Z [2024-07-04T01:40:20.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:40:06.174211+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:17.226151+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:40:20.076595995Z [2024-07-04T01:40:20.076+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:20.088369261Z [2024-07-04T01:40:20.087+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:20.125440977Z [2024-07-04T01:40:20.125+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T013900, start_date=, end_date=20240704T014020 2024-07-04T01:40:20.138380209Z [2024-07-04T01:40:20.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:40:06.148531+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:40:17.226151+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:40:20.138925237Z [2024-07-04T01:40:20.138+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:20.143702179Z [2024-07-04T01:40:20.143+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:40:20.155920961Z [2024-07-04T01:40:20.155+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T013900, start_date=, end_date=20240704T014020 2024-07-04T01:40:21.255751422Z [2024-07-04T01:40:21.255+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T01:40:21.256328709Z [2024-07-04T01:40:21.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:39:00+00:00, run_id=scheduled__2024-07-04T01:39:00+00:00, run_start_date=2024-07-04 01:40:00.414141+00:00, run_end_date=2024-07-04 01:40:21.255857+00:00, run_duration=20.841716, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:39:00+00:00, data_interval_end=2024-07-04 01:40:00+00:00, dag_hash=b7541a35136af9db48a9f03e98535b6f 2024-07-04T01:40:21.271304310Z [2024-07-04T01:40:21.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:41:00+00:00 2024-07-04T01:40:21.292475759Z [2024-07-04T01:40:21.291+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T01:40:21.293534910Z [2024-07-04T01:40:21.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:39:00+00:00, run_id=scheduled__2024-07-04T01:39:00+00:00, run_start_date=2024-07-04 01:40:00.416366+00:00, run_end_date=2024-07-04 01:40:21.293028+00:00, run_duration=20.876662, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:39:00+00:00, data_interval_end=2024-07-04 01:40:00+00:00, dag_hash=3bc69dfe47ffd351686f168b6171ee80 2024-07-04T01:40:21.308950900Z [2024-07-04T01:40:21.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:41:00+00:00 2024-07-04T01:40:22.824836224Z [2024-07-04T01:40:22.823+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T01:40:22.825061741Z [2024-07-04T01:40:22.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:35:00+00:00, run_id=scheduled__2024-07-04T01:35:00+00:00, run_start_date=2024-07-04 01:40:00.407417+00:00, run_end_date=2024-07-04 01:40:22.824423+00:00, run_duration=22.417006, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:35:00+00:00, data_interval_end=2024-07-04 01:40:00+00:00, dag_hash=fe3b9591aaaf627bb760a9fa5889ca7b 2024-07-04T01:40:22.833548888Z [2024-07-04T01:40:22.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:40:00+00:00, run_after=2024-07-04T01:45:00+00:00 2024-07-04T01:41:00.526961301Z [2024-07-04T01:41:00.525+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:41:00.539895562Z [2024-07-04T01:41:00.539+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:41:00.553707539Z [2024-07-04T01:41:00.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:41:00+00:00, run_after=2024-07-04T01:42:00+00:00 2024-07-04T01:41:00.566014453Z [2024-07-04T01:41:00.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:41:00+00:00, run_after=2024-07-04T01:42:00+00:00 2024-07-04T01:41:00.659857946Z [2024-07-04T01:41:00.659+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T01:41:00.659881934Z 2024-07-04T01:41:00.659885805Z 2024-07-04T01:41:00.659889252Z 2024-07-04T01:41:00.659892481Z 2024-07-04T01:41:00.659995975Z [2024-07-04T01:41:00.659+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:41:00.660123182Z [2024-07-04T01:41:00.660+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:41:00.660235090Z [2024-07-04T01:41:00.660+0000] {scheduler_job.py:425} INFO - DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:41:00.660350277Z [2024-07-04T01:41:00.660+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:41:00.661005866Z [2024-07-04T01:41:00.660+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:41:00.661013844Z 2024-07-04T01:41:00.661020219Z 2024-07-04T01:41:00.661023343Z 2024-07-04T01:41:00.661026356Z 2024-07-04T01:41:00.664522544Z [2024-07-04T01:41:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:41:00.664738973Z [2024-07-04T01:41:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:41:00.665041577Z [2024-07-04T01:41:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:41:00.665202877Z [2024-07-04T01:41:00.665+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:41:00.665760023Z [2024-07-04T01:41:00.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:41:00.665966221Z [2024-07-04T01:41:00.665+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:41:00.666229819Z [2024-07-04T01:41:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:41:00.666413151Z [2024-07-04T01:41:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:41:01.234683301Z [2024-07-04T01:41:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 1 2024-07-04T01:41:01.234714246Z [2024-07-04T01:41:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 1 2024-07-04T01:41:01.234784582Z [2024-07-04T01:41:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 1 2024-07-04T01:41:01.234942473Z [2024-07-04T01:41:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 1 2024-07-04T01:41:01.248662096Z [2024-07-04T01:41:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4add98f0-173d-4440-b046-68d568594cd8 2024-07-04T01:41:01.248718794Z [2024-07-04T01:41:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1b92884-8216-4701-b38a-25e89b22a3ef 2024-07-04T01:41:01.248813099Z [2024-07-04T01:41:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0f2284c-12dd-4ee2-b58e-619715b13d3b 2024-07-04T01:41:01.248910968Z [2024-07-04T01:41:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64b967c9-8415-4b21-9f4a-7f4003bf81b1 2024-07-04T01:41:03.621590989Z [2024-07-04T01:41:03.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status failed for try_number 1 2024-07-04T01:41:03.622129367Z [2024-07-04T01:41:03.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status failed for try_number 1 2024-07-04T01:41:03.633938457Z [2024-07-04T01:41:03.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:41:00.661954+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:41:03.634587587Z [2024-07-04T01:41:03.634+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:41:03.637796169Z [2024-07-04T01:41:03.637+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:41:03.659490252Z [2024-07-04T01:41:03.659+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T014000, start_date=, end_date=20240704T014103 2024-07-04T01:41:03.673704005Z [2024-07-04T01:41:03.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:41:00.661954+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:41:03.674509055Z [2024-07-04T01:41:03.674+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:41:03.679056956Z [2024-07-04T01:41:03.678+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:41:03.700862304Z [2024-07-04T01:41:03.700+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T014000, start_date=, end_date=20240704T014103 2024-07-04T01:41:04.538717436Z [2024-07-04T01:41:04.538+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:41:04.539735313Z [2024-07-04T01:41:04.539+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:40:00+00:00, run_id=scheduled__2024-07-04T01:40:00+00:00, run_start_date=2024-07-04 01:41:00.595357+00:00, run_end_date=2024-07-04 01:41:04.538712+00:00, run_duration=3.943355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:40:00+00:00, data_interval_end=2024-07-04 01:41:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:41:04.556105519Z [2024-07-04T01:41:04.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:41:00+00:00, run_after=2024-07-04T01:42:00+00:00 2024-07-04T01:41:05.722921280Z [2024-07-04T01:41:05.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:41:05.723580463Z [2024-07-04T01:41:05.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:40:00+00:00, run_id=scheduled__2024-07-04T01:40:00+00:00, run_start_date=2024-07-04 01:41:00.596964+00:00, run_end_date=2024-07-04 01:41:05.723239+00:00, run_duration=5.126275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:40:00+00:00, data_interval_end=2024-07-04 01:41:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:41:05.734063873Z [2024-07-04T01:41:05.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:41:00+00:00, run_after=2024-07-04T01:42:00+00:00 2024-07-04T01:41:05.810019412Z [2024-07-04T01:41:05.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status success for try_number 1 2024-07-04T01:41:05.810325576Z [2024-07-04T01:41:05.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status success for try_number 1 2024-07-04T01:41:05.818002203Z [2024-07-04T01:41:05.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=2024-07-04 01:41:02.813697+00:00, run_end_date=2024-07-04 01:41:04.454153+00:00, run_duration=1.640456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:41:00.661954+00:00, queued_by_job_id=2, pid=1563 2024-07-04T01:41:05.818324589Z [2024-07-04T01:41:05.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=2024-07-04 01:41:03.054172+00:00, run_end_date=2024-07-04 01:41:04.933232+00:00, run_duration=1.87906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:41:00.661954+00:00, queued_by_job_id=2, pid=1573 2024-07-04T01:41:14.492760819Z [2024-07-04T01:41:14.492+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:41:14.492814489Z 2024-07-04T01:41:14.492819755Z 2024-07-04T01:41:14.492927734Z [2024-07-04T01:41:14.492+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:41:14.493118842Z [2024-07-04T01:41:14.492+0000] {scheduler_job.py:425} INFO - DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 has 0/16 running and queued tasks 2024-07-04T01:41:14.493796338Z [2024-07-04T01:41:14.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:41:14.493811950Z 2024-07-04T01:41:14.493817983Z 2024-07-04T01:41:14.496812886Z [2024-07-04T01:41:14.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:41:14.496970651Z [2024-07-04T01:41:14.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:41:14.497276069Z [2024-07-04T01:41:14.497+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:41:14.497443155Z [2024-07-04T01:41:14.497+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:41:14.650482641Z [2024-07-04T01:41:14.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 2 2024-07-04T01:41:14.653375210Z [2024-07-04T01:41:14.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 2 2024-07-04T01:41:14.661194898Z [2024-07-04T01:41:14.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ac0238b-3dbd-4d73-9aaf-73687b4601d6 2024-07-04T01:41:14.661370470Z [2024-07-04T01:41:14.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to eaa66fe4-d14b-4baf-8233-5c8ad8815df2 2024-07-04T01:41:17.048254885Z [2024-07-04T01:41:17.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status failed for try_number 2 2024-07-04T01:41:17.048472589Z [2024-07-04T01:41:17.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status failed for try_number 2 2024-07-04T01:41:17.059064544Z [2024-07-04T01:41:17.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:41:03.642154+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:41:14.494321+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:41:17.059725464Z [2024-07-04T01:41:17.059+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:41:17.065083433Z [2024-07-04T01:41:17.064+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:41:17.085241184Z [2024-07-04T01:41:17.084+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T014000, start_date=, end_date=20240704T014117 2024-07-04T01:41:17.101367468Z [2024-07-04T01:41:17.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 01:41:03.684114+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:41:14.494321+00:00, queued_by_job_id=2, pid=None 2024-07-04T01:41:17.102011410Z [2024-07-04T01:41:17.101+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:41:17.106690855Z [2024-07-04T01:41:17.106+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T01:41:17.136996031Z [2024-07-04T01:41:17.136+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T014000, start_date=, end_date=20240704T014117 2024-07-04T01:41:18.228533227Z [2024-07-04T01:41:18.227+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T01:41:18.228847378Z [2024-07-04T01:41:18.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:40:00+00:00, run_id=scheduled__2024-07-04T01:40:00+00:00, run_start_date=2024-07-04 01:41:00.599750+00:00, run_end_date=2024-07-04 01:41:18.228204+00:00, run_duration=17.628454, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:40:00+00:00, data_interval_end=2024-07-04 01:41:00+00:00, dag_hash=3bc69dfe47ffd351686f168b6171ee80 2024-07-04T01:41:18.239832604Z [2024-07-04T01:41:18.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:41:00+00:00, run_after=2024-07-04T01:42:00+00:00 2024-07-04T01:41:18.249565008Z [2024-07-04T01:41:18.249+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T01:41:18.249831632Z [2024-07-04T01:41:18.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4, execution_date=2024-07-04 01:40:00+00:00, run_id=scheduled__2024-07-04T01:40:00+00:00, run_start_date=2024-07-04 01:41:00.589711+00:00, run_end_date=2024-07-04 01:41:18.249259+00:00, run_duration=17.659548, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:40:00+00:00, data_interval_end=2024-07-04 01:41:00+00:00, dag_hash=b7541a35136af9db48a9f03e98535b6f 2024-07-04T01:41:18.260910550Z [2024-07-04T01:41:18.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 to 2024-07-04T01:41:00+00:00, run_after=2024-07-04T01:42:00+00:00 2024-07-04T01:41:20.977540961Z [2024-07-04T01:41:20.976+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T01:42:00.585761099Z [2024-07-04T01:42:00.579+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:42:00.593790457Z [2024-07-04T01:42:00.593+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:42:00.606801833Z [2024-07-04T01:42:00.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:42:00+00:00, run_after=2024-07-04T01:43:00+00:00 2024-07-04T01:42:00.678958716Z [2024-07-04T01:42:00.678+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:42:00.678983156Z 2024-07-04T01:42:00.678989334Z 2024-07-04T01:42:00.678993246Z 2024-07-04T01:42:00.679241049Z [2024-07-04T01:42:00.679+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:42:00.679519980Z [2024-07-04T01:42:00.679+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:42:00.679690077Z [2024-07-04T01:42:00.679+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:42:00.680347458Z [2024-07-04T01:42:00.680+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:42:00.680359377Z 2024-07-04T01:42:00.680363337Z 2024-07-04T01:42:00.680366527Z 2024-07-04T01:42:00.683855142Z [2024-07-04T01:42:00.683+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:42:00.684048085Z [2024-07-04T01:42:00.683+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:42:00.684352366Z [2024-07-04T01:42:00.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:42:00.684513886Z [2024-07-04T01:42:00.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:42:00.684845799Z [2024-07-04T01:42:00.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:42:00.685008996Z [2024-07-04T01:42:00.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:42:01.148008862Z [2024-07-04T01:42:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 1 2024-07-04T01:42:01.151158895Z [2024-07-04T01:42:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:41:00+00:00 exited with status queued for try_number 1 2024-07-04T01:42:01.151291910Z [2024-07-04T01:42:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:41:00+00:00 exited with status queued for try_number 1 2024-07-04T01:42:01.176298329Z [2024-07-04T01:42:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 761c630f-96a3-45ea-ab92-fdaf3780465e 2024-07-04T01:42:01.176515192Z [2024-07-04T01:42:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29bb08aa-e67c-4210-9c66-62fdae75f80e 2024-07-04T01:42:01.176685041Z [2024-07-04T01:42:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 256a0632-0ad1-4e53-86ad-0e8aa8cabe1f 2024-07-04T01:42:02.695489712Z [2024-07-04T01:42:02.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:42:02.696598901Z [2024-07-04T01:42:02.696+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:40:00+00:00, run_id=scheduled__2024-07-04T01:40:00+00:00, run_start_date=2024-07-04 01:42:00.618592+00:00, run_end_date=2024-07-04 01:42:02.695442+00:00, run_duration=2.07685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:40:00+00:00, data_interval_end=2024-07-04 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:42:02.705728304Z [2024-07-04T01:42:02.705+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:42:00+00:00, run_after=2024-07-04T01:44:00+00:00 2024-07-04T01:42:02.751402539Z [2024-07-04T01:42:02.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status success for try_number 1 2024-07-04T01:42:02.765982569Z [2024-07-04T01:42:02.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=2024-07-04 01:42:01.951600+00:00, run_end_date=2024-07-04 01:42:02.325394+00:00, run_duration=0.373794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:42:00.681126+00:00, queued_by_job_id=2, pid=1647 2024-07-04T01:42:04.914461475Z [2024-07-04T01:42:04.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:42:04.915324208Z [2024-07-04T01:42:04.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:41:00+00:00, run_id=scheduled__2024-07-04T01:41:00+00:00, run_start_date=2024-07-04 01:42:00.623483+00:00, run_end_date=2024-07-04 01:42:04.914653+00:00, run_duration=4.29117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:41:00+00:00, data_interval_end=2024-07-04 01:42:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:42:04.931073843Z [2024-07-04T01:42:04.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:42:00+00:00, run_after=2024-07-04T01:43:00+00:00 2024-07-04T01:42:06.047257800Z [2024-07-04T01:42:06.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:42:06.047453199Z [2024-07-04T01:42:06.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:41:00+00:00, run_id=scheduled__2024-07-04T01:41:00+00:00, run_start_date=2024-07-04 01:42:00.621926+00:00, run_end_date=2024-07-04 01:42:06.047070+00:00, run_duration=5.425144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:41:00+00:00, data_interval_end=2024-07-04 01:42:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:42:06.059111730Z [2024-07-04T01:42:06.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:42:00+00:00, run_after=2024-07-04T01:43:00+00:00 2024-07-04T01:42:06.101617446Z [2024-07-04T01:42:06.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:41:00+00:00 exited with status success for try_number 1 2024-07-04T01:42:06.101683923Z [2024-07-04T01:42:06.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:41:00+00:00 exited with status success for try_number 1 2024-07-04T01:42:06.110478739Z [2024-07-04T01:42:06.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:41:00+00:00, map_index=-1, run_start_date=2024-07-04 01:42:03.000004+00:00, run_end_date=2024-07-04 01:42:05.201070+00:00, run_duration=2.201066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:42:00.681126+00:00, queued_by_job_id=2, pid=1677 2024-07-04T01:42:06.111081891Z [2024-07-04T01:42:06.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:41:00+00:00, map_index=-1, run_start_date=2024-07-04 01:42:03.058075+00:00, run_end_date=2024-07-04 01:42:04.829921+00:00, run_duration=1.771846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:42:00.681126+00:00, queued_by_job_id=2, pid=1678 2024-07-04T01:43:01.085050479Z [2024-07-04T01:43:01.084+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:43:01.104514133Z [2024-07-04T01:43:01.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:43:00+00:00, run_after=2024-07-04T01:44:00+00:00 2024-07-04T01:43:01.181197110Z [2024-07-04T01:43:01.180+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:43:01.181224807Z 2024-07-04T01:43:01.181229633Z 2024-07-04T01:43:01.181422949Z [2024-07-04T01:43:01.181+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:43:01.181580305Z [2024-07-04T01:43:01.181+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:43:01.182264997Z [2024-07-04T01:43:01.182+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:43:01.182278380Z 2024-07-04T01:43:01.182282168Z 2024-07-04T01:43:01.185285156Z [2024-07-04T01:43:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:43:01.189465474Z [2024-07-04T01:43:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:43:01.189823344Z [2024-07-04T01:43:01.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:43:01.190089462Z [2024-07-04T01:43:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:43:01.428702461Z [2024-07-04T01:43:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:42:00+00:00 exited with status queued for try_number 1 2024-07-04T01:43:01.428909619Z [2024-07-04T01:43:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:42:00+00:00 exited with status queued for try_number 1 2024-07-04T01:43:01.446064515Z [2024-07-04T01:43:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24c678a4-8a09-4604-ba36-bf85435aa0a1 2024-07-04T01:43:01.446373501Z [2024-07-04T01:43:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07c046be-8547-48b4-b689-9fbbc53a4474 2024-07-04T01:43:05.365726740Z [2024-07-04T01:43:05.365+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:43:05.366097611Z [2024-07-04T01:43:05.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:42:00+00:00, run_id=scheduled__2024-07-04T01:42:00+00:00, run_start_date=2024-07-04 01:43:01.117499+00:00, run_end_date=2024-07-04 01:43:05.365602+00:00, run_duration=4.248103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:42:00+00:00, data_interval_end=2024-07-04 01:43:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:43:05.376280119Z [2024-07-04T01:43:05.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:43:00+00:00, run_after=2024-07-04T01:44:00+00:00 2024-07-04T01:43:05.407922846Z [2024-07-04T01:43:05.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:42:00+00:00 exited with status success for try_number 1 2024-07-04T01:43:05.414886675Z [2024-07-04T01:43:05.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:42:00+00:00, map_index=-1, run_start_date=2024-07-04 01:43:03.206350+00:00, run_end_date=2024-07-04 01:43:04.889571+00:00, run_duration=1.683221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:43:01.182873+00:00, queued_by_job_id=2, pid=1733 2024-07-04T01:43:06.479934620Z [2024-07-04T01:43:06.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:43:06.480459107Z [2024-07-04T01:43:06.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:42:00+00:00, run_id=scheduled__2024-07-04T01:42:00+00:00, run_start_date=2024-07-04 01:43:01.115639+00:00, run_end_date=2024-07-04 01:43:06.479676+00:00, run_duration=5.364037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:42:00+00:00, data_interval_end=2024-07-04 01:43:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:43:06.509558883Z [2024-07-04T01:43:06.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:43:00+00:00, run_after=2024-07-04T01:44:00+00:00 2024-07-04T01:43:06.553972878Z [2024-07-04T01:43:06.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:42:00+00:00 exited with status success for try_number 1 2024-07-04T01:43:06.560134447Z [2024-07-04T01:43:06.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:42:00+00:00, map_index=-1, run_start_date=2024-07-04 01:43:03.173638+00:00, run_end_date=2024-07-04 01:43:05.942767+00:00, run_duration=2.769129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:43:01.182873+00:00, queued_by_job_id=2, pid=1732 2024-07-04T01:44:00.045579421Z [2024-07-04T01:44:00.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:44:00+00:00, run_after=2024-07-04T01:45:00+00:00 2024-07-04T01:44:00.054279574Z [2024-07-04T01:44:00.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:44:00.061733001Z [2024-07-04T01:44:00.061+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:44:00.133888596Z [2024-07-04T01:44:00.133+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:44:00.133915092Z 2024-07-04T01:44:00.133919556Z 2024-07-04T01:44:00.133923268Z 2024-07-04T01:44:00.134076054Z [2024-07-04T01:44:00.133+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:44:00.134205180Z [2024-07-04T01:44:00.134+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:44:00.134391830Z [2024-07-04T01:44:00.134+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:44:00.135814690Z [2024-07-04T01:44:00.135+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:44:00.135833425Z 2024-07-04T01:44:00.135839092Z 2024-07-04T01:44:00.135844185Z 2024-07-04T01:44:00.143992244Z [2024-07-04T01:44:00.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:44:00.144804666Z [2024-07-04T01:44:00.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:44:00.145087255Z [2024-07-04T01:44:00.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:44:00.145264717Z [2024-07-04T01:44:00.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:44:00.145529439Z [2024-07-04T01:44:00.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:44:00.145679981Z [2024-07-04T01:44:00.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:44:00.581671376Z [2024-07-04T01:44:00.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:42:00+00:00 exited with status queued for try_number 1 2024-07-04T01:44:00.584020589Z [2024-07-04T01:44:00.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:43:00+00:00 exited with status queued for try_number 1 2024-07-04T01:44:00.584233346Z [2024-07-04T01:44:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:43:00+00:00 exited with status queued for try_number 1 2024-07-04T01:44:00.599149879Z [2024-07-04T01:44:00.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2edf14d-0f3a-4b34-a686-5ac905db69aa 2024-07-04T01:44:00.599272474Z [2024-07-04T01:44:00.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2883cd9f-1af6-46d1-8c63-08421f0af6c6 2024-07-04T01:44:00.599428292Z [2024-07-04T01:44:00.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5e87a6a-825c-44e0-9cd7-905b4f742c58 2024-07-04T01:44:02.915995213Z [2024-07-04T01:44:02.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:44:02.916380700Z [2024-07-04T01:44:02.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:42:00+00:00, run_id=scheduled__2024-07-04T01:42:00+00:00, run_start_date=2024-07-04 01:44:00.078261+00:00, run_end_date=2024-07-04 01:44:02.915940+00:00, run_duration=2.837679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:42:00+00:00, data_interval_end=2024-07-04 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:44:02.925311452Z [2024-07-04T01:44:02.924+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:44:00+00:00, run_after=2024-07-04T01:46:00+00:00 2024-07-04T01:44:02.994748918Z [2024-07-04T01:44:02.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:42:00+00:00 exited with status success for try_number 1 2024-07-04T01:44:03.000284731Z [2024-07-04T01:44:02.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:42:00+00:00, map_index=-1, run_start_date=2024-07-04 01:44:01.312858+00:00, run_end_date=2024-07-04 01:44:01.912643+00:00, run_duration=0.599785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:44:00.139881+00:00, queued_by_job_id=2, pid=1767 2024-07-04T01:44:05.168546219Z [2024-07-04T01:44:05.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:44:05.168980325Z [2024-07-04T01:44:05.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:43:00+00:00, run_id=scheduled__2024-07-04T01:43:00+00:00, run_start_date=2024-07-04 01:44:00.079919+00:00, run_end_date=2024-07-04 01:44:05.168440+00:00, run_duration=5.088521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:43:00+00:00, data_interval_end=2024-07-04 01:44:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:44:05.182406251Z [2024-07-04T01:44:05.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:44:00+00:00, run_after=2024-07-04T01:45:00+00:00 2024-07-04T01:44:05.219156667Z [2024-07-04T01:44:05.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:43:00+00:00 exited with status success for try_number 1 2024-07-04T01:44:05.224647302Z [2024-07-04T01:44:05.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:43:00+00:00, map_index=-1, run_start_date=2024-07-04 01:44:02.621860+00:00, run_end_date=2024-07-04 01:44:04.346060+00:00, run_duration=1.7242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:44:00.139881+00:00, queued_by_job_id=2, pid=1798 2024-07-04T01:44:06.282313427Z [2024-07-04T01:44:06.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:44:06.282972441Z [2024-07-04T01:44:06.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:43:00+00:00, run_id=scheduled__2024-07-04T01:43:00+00:00, run_start_date=2024-07-04 01:44:00.081220+00:00, run_end_date=2024-07-04 01:44:06.282514+00:00, run_duration=6.201294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:43:00+00:00, data_interval_end=2024-07-04 01:44:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:44:06.294014118Z [2024-07-04T01:44:06.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:44:00+00:00, run_after=2024-07-04T01:45:00+00:00 2024-07-04T01:44:06.336585451Z [2024-07-04T01:44:06.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:43:00+00:00 exited with status success for try_number 1 2024-07-04T01:44:06.342061802Z [2024-07-04T01:44:06.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:43:00+00:00, map_index=-1, run_start_date=2024-07-04 01:44:02.560014+00:00, run_end_date=2024-07-04 01:44:05.369590+00:00, run_duration=2.809576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:44:00.139881+00:00, queued_by_job_id=2, pid=1797 2024-07-04T01:45:00.958727454Z [2024-07-04T01:45:00.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:45:00+00:00, run_after=2024-07-04T01:50:00+00:00 2024-07-04T01:45:00.972015934Z [2024-07-04T01:45:00.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:45:00+00:00, run_after=2024-07-04T01:46:00+00:00 2024-07-04T01:45:00.979384076Z [2024-07-04T01:45:00.979+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:45:01.093812856Z [2024-07-04T01:45:01.093+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:45:01.093843992Z 2024-07-04T01:45:01.093855235Z 2024-07-04T01:45:01.093861282Z 2024-07-04T01:45:01.093880215Z [2024-07-04T01:45:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:45:01.094378118Z [2024-07-04T01:45:01.093+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:45:01.094620558Z [2024-07-04T01:45:01.094+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:45:01.095404809Z [2024-07-04T01:45:01.095+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:45:01.095438632Z 2024-07-04T01:45:01.095445932Z 2024-07-04T01:45:01.095452248Z 2024-07-04T01:45:01.099759633Z [2024-07-04T01:45:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:45:01.100019564Z [2024-07-04T01:45:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:45:01.100412596Z [2024-07-04T01:45:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:45:01.100522623Z [2024-07-04T01:45:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:45:01.100785911Z [2024-07-04T01:45:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:45:01.100906125Z [2024-07-04T01:45:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:45:01.424389634Z [2024-07-04T01:45:01.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 1 2024-07-04T01:45:01.427304521Z [2024-07-04T01:45:01.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:44:00+00:00 exited with status queued for try_number 1 2024-07-04T01:45:01.427546107Z [2024-07-04T01:45:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:44:00+00:00 exited with status queued for try_number 1 2024-07-04T01:45:01.440613745Z [2024-07-04T01:45:01.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb437495-439e-4577-be56-6aaf4a5f6e84 2024-07-04T01:45:01.441333941Z [2024-07-04T01:45:01.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a03b06c-0287-4a85-a791-2aeb87b7cafd 2024-07-04T01:45:01.441476908Z [2024-07-04T01:45:01.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c318f3e-313c-4e06-9576-c019d126defb 2024-07-04T01:45:03.949407193Z [2024-07-04T01:45:03.948+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:45:03.949485039Z 2024-07-04T01:45:03.949508818Z [2024-07-04T01:45:03.949+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:45:03.950090657Z [2024-07-04T01:45:03.949+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:45:03.950121382Z 2024-07-04T01:45:03.952654387Z [2024-07-04T01:45:03.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T01:45:03.952822083Z [2024-07-04T01:45:03.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:45:04.013260562Z [2024-07-04T01:45:04.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 1 2024-07-04T01:45:04.013284963Z [2024-07-04T01:45:04.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status success for try_number 1 2024-07-04T01:45:04.021932776Z [2024-07-04T01:45:04.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=2024-07-04 01:45:03.122818+00:00, run_end_date=2024-07-04 01:45:03.597396+00:00, run_duration=0.474578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:45:01.096297+00:00, queued_by_job_id=2, pid=1865 2024-07-04T01:45:04.022172694Z [2024-07-04T01:45:04.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ac4c9a2-0b2d-4c19-9950-d2c33b47adf5 2024-07-04T01:45:05.195084243Z [2024-07-04T01:45:05.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:45:05.195445091Z [2024-07-04T01:45:05.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:44:00+00:00, run_id=scheduled__2024-07-04T01:44:00+00:00, run_start_date=2024-07-04 01:45:00.999535+00:00, run_end_date=2024-07-04 01:45:05.194948+00:00, run_duration=4.195413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:44:00+00:00, data_interval_end=2024-07-04 01:45:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:45:05.205073778Z [2024-07-04T01:45:05.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:45:00+00:00, run_after=2024-07-04T01:46:00+00:00 2024-07-04T01:45:05.212357962Z [2024-07-04T01:45:05.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:45:05.212867119Z [2024-07-04T01:45:05.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:44:00+00:00, run_id=scheduled__2024-07-04T01:44:00+00:00, run_start_date=2024-07-04 01:45:01.007661+00:00, run_end_date=2024-07-04 01:45:05.212244+00:00, run_duration=4.204583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:44:00+00:00, data_interval_end=2024-07-04 01:45:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:45:05.221898516Z [2024-07-04T01:45:05.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:45:00+00:00, run_after=2024-07-04T01:46:00+00:00 2024-07-04T01:45:05.268788411Z [2024-07-04T01:45:05.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:44:00+00:00 exited with status success for try_number 1 2024-07-04T01:45:05.268884138Z [2024-07-04T01:45:05.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:44:00+00:00 exited with status success for try_number 1 2024-07-04T01:45:05.276548044Z [2024-07-04T01:45:05.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:44:00+00:00, map_index=-1, run_start_date=2024-07-04 01:45:03.121533+00:00, run_end_date=2024-07-04 01:45:04.550417+00:00, run_duration=1.428884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:45:01.096297+00:00, queued_by_job_id=2, pid=1864 2024-07-04T01:45:05.276636730Z [2024-07-04T01:45:05.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:44:00+00:00, map_index=-1, run_start_date=2024-07-04 01:45:03.113420+00:00, run_end_date=2024-07-04 01:45:04.882495+00:00, run_duration=1.769075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:45:01.096297+00:00, queued_by_job_id=2, pid=1863 2024-07-04T01:45:06.357401777Z [2024-07-04T01:45:06.356+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:45:06.357442063Z 2024-07-04T01:45:06.357866944Z [2024-07-04T01:45:06.357+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:45:06.358781441Z [2024-07-04T01:45:06.358+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:45:06.358793789Z 2024-07-04T01:45:06.362158470Z [2024-07-04T01:45:06.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T01:45:06.362447073Z [2024-07-04T01:45:06.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:45:06.428766754Z [2024-07-04T01:45:06.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 1 2024-07-04T01:45:06.430848003Z [2024-07-04T01:45:06.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status success for try_number 1 2024-07-04T01:45:06.439827704Z [2024-07-04T01:45:06.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=2024-07-04 01:45:05.691572+00:00, run_end_date=2024-07-04 01:45:06.024694+00:00, run_duration=0.333122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:45:03.950452+00:00, queued_by_job_id=2, pid=1903 2024-07-04T01:45:06.441192313Z [2024-07-04T01:45:06.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43c7f0cf-0b68-4940-9b08-3635210bf583 2024-07-04T01:45:11.222740751Z [2024-07-04T01:45:11.222+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:45:11.222770321Z 2024-07-04T01:45:11.223214287Z [2024-07-04T01:45:11.222+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:45:11.224242387Z [2024-07-04T01:45:11.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:45:11.224253675Z 2024-07-04T01:45:11.226964459Z [2024-07-04T01:45:11.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:45:11.227187577Z [2024-07-04T01:45:11.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:45:11.298920758Z [2024-07-04T01:45:11.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status queued for try_number 1 2024-07-04T01:45:11.298951736Z [2024-07-04T01:45:11.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status success for try_number 1 2024-07-04T01:45:11.307525924Z [2024-07-04T01:45:11.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=0, run_start_date=2024-07-04 01:45:08.033220+00:00, run_end_date=2024-07-04 01:45:10.242176+00:00, run_duration=2.208956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:45:06.359331+00:00, queued_by_job_id=2, pid=1915 2024-07-04T01:45:11.308090275Z [2024-07-04T01:45:11.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to ace94f26-779b-4c4d-a6bb-1bab7f490bea 2024-07-04T01:45:13.827935566Z [2024-07-04T01:45:13.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:45:13.828574179Z [2024-07-04T01:45:13.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:40:00+00:00, run_id=scheduled__2024-07-04T01:40:00+00:00, run_start_date=2024-07-04 01:45:00.994672+00:00, run_end_date=2024-07-04 01:45:13.827821+00:00, run_duration=12.833149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:40:00+00:00, data_interval_end=2024-07-04 01:45:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T01:45:13.837931343Z [2024-07-04T01:45:13.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:45:00+00:00, run_after=2024-07-04T01:50:00+00:00 2024-07-04T01:45:13.873774516Z [2024-07-04T01:45:13.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:40:00+00:00 exited with status success for try_number 1 2024-07-04T01:45:13.882265701Z [2024-07-04T01:45:13.881+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T01:40:00+00:00, map_index=-1, run_start_date=2024-07-04 01:45:12.989964+00:00, run_end_date=2024-07-04 01:45:13.442000+00:00, run_duration=0.452036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:45:11.224756+00:00, queued_by_job_id=2, pid=1936 2024-07-04T01:46:00.932185439Z [2024-07-04T01:46:00.931+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:46:00.943170768Z [2024-07-04T01:46:00.942+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:46:00.960775173Z [2024-07-04T01:46:00.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:46:00+00:00, run_after=2024-07-04T01:47:00+00:00 2024-07-04T01:46:01.032378890Z [2024-07-04T01:46:01.031+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:46:01.032413349Z 2024-07-04T01:46:01.032417915Z 2024-07-04T01:46:01.032421453Z 2024-07-04T01:46:01.032635802Z [2024-07-04T01:46:01.032+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:46:01.032846792Z [2024-07-04T01:46:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:46:01.033055825Z [2024-07-04T01:46:01.032+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:46:01.033776031Z [2024-07-04T01:46:01.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:46:01.033787613Z 2024-07-04T01:46:01.033791596Z 2024-07-04T01:46:01.033801739Z 2024-07-04T01:46:01.037442758Z [2024-07-04T01:46:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:46:01.037750635Z [2024-07-04T01:46:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:46:01.038113830Z [2024-07-04T01:46:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:46:01.038318534Z [2024-07-04T01:46:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:46:01.038642801Z [2024-07-04T01:46:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:46:01.038847730Z [2024-07-04T01:46:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:46:01.390936200Z [2024-07-04T01:46:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:44:00+00:00 exited with status queued for try_number 1 2024-07-04T01:46:01.391125765Z [2024-07-04T01:46:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status queued for try_number 1 2024-07-04T01:46:01.391240065Z [2024-07-04T01:46:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status queued for try_number 1 2024-07-04T01:46:01.412531453Z [2024-07-04T01:46:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c817898-78a6-4f12-9843-448be45f6da4 2024-07-04T01:46:01.412793046Z [2024-07-04T01:46:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13d91f45-a259-4f78-b683-8e5c397c7f02 2024-07-04T01:46:01.412967127Z [2024-07-04T01:46:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to e08a5bfc-f153-4ae5-a1d8-fa04ef410e4b 2024-07-04T01:46:02.999300941Z [2024-07-04T01:46:02.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:46:02.999682001Z [2024-07-04T01:46:02.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:44:00+00:00, run_id=scheduled__2024-07-04T01:44:00+00:00, run_start_date=2024-07-04 01:46:00.975259+00:00, run_end_date=2024-07-04 01:46:02.999279+00:00, run_duration=2.02402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:44:00+00:00, data_interval_end=2024-07-04 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:46:03.013980660Z [2024-07-04T01:46:03.013+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:46:00+00:00, run_after=2024-07-04T01:48:00+00:00 2024-07-04T01:46:03.068671130Z [2024-07-04T01:46:03.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:44:00+00:00 exited with status success for try_number 1 2024-07-04T01:46:03.074826689Z [2024-07-04T01:46:03.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:44:00+00:00, map_index=-1, run_start_date=2024-07-04 01:46:01.960404+00:00, run_end_date=2024-07-04 01:46:02.437628+00:00, run_duration=0.477224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:46:01.034576+00:00, queued_by_job_id=2, pid=1954 2024-07-04T01:46:04.951110691Z [2024-07-04T01:46:04.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:46:04.951568714Z [2024-07-04T01:46:04.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:45:00+00:00, run_id=scheduled__2024-07-04T01:45:00+00:00, run_start_date=2024-07-04 01:46:00.978524+00:00, run_end_date=2024-07-04 01:46:04.951138+00:00, run_duration=3.972614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:45:00+00:00, data_interval_end=2024-07-04 01:46:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:46:04.961884862Z [2024-07-04T01:46:04.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:46:00+00:00, run_after=2024-07-04T01:47:00+00:00 2024-07-04T01:46:05.008979786Z [2024-07-04T01:46:05.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status success for try_number 1 2024-07-04T01:46:05.017265049Z [2024-07-04T01:46:05.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:45:00+00:00, map_index=-1, run_start_date=2024-07-04 01:46:03.107822+00:00, run_end_date=2024-07-04 01:46:04.683841+00:00, run_duration=1.576019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:46:01.034576+00:00, queued_by_job_id=2, pid=1984 2024-07-04T01:46:06.094618695Z [2024-07-04T01:46:06.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:46:06.095079827Z [2024-07-04T01:46:06.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:45:00+00:00, run_id=scheduled__2024-07-04T01:45:00+00:00, run_start_date=2024-07-04 01:46:00.977241+00:00, run_end_date=2024-07-04 01:46:06.094599+00:00, run_duration=5.117358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:45:00+00:00, data_interval_end=2024-07-04 01:46:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:46:06.107069384Z [2024-07-04T01:46:06.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:46:00+00:00, run_after=2024-07-04T01:47:00+00:00 2024-07-04T01:46:06.147911071Z [2024-07-04T01:46:06.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status success for try_number 1 2024-07-04T01:46:06.155612047Z [2024-07-04T01:46:06.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:45:00+00:00, map_index=-1, run_start_date=2024-07-04 01:46:03.329444+00:00, run_end_date=2024-07-04 01:46:05.408875+00:00, run_duration=2.079431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:46:01.034576+00:00, queued_by_job_id=2, pid=1985 2024-07-04T01:46:21.074448402Z [2024-07-04T01:46:21.073+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T01:47:00.904716661Z [2024-07-04T01:47:00.904+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:47:00.918027225Z [2024-07-04T01:47:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:47:00+00:00, run_after=2024-07-04T01:48:00+00:00 2024-07-04T01:47:00.980954566Z [2024-07-04T01:47:00.980+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:47:00.980993872Z 2024-07-04T01:47:00.981002635Z 2024-07-04T01:47:00.981010463Z [2024-07-04T01:47:00.980+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:47:00.981200701Z [2024-07-04T01:47:00.980+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:47:00.982058705Z [2024-07-04T01:47:00.981+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:47:00.982079390Z 2024-07-04T01:47:00.982096405Z 2024-07-04T01:47:00.986060182Z [2024-07-04T01:47:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:47:00.986101501Z [2024-07-04T01:47:00.985+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:47:00.986612610Z [2024-07-04T01:47:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:47:00.986791601Z [2024-07-04T01:47:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:47:01.163253921Z [2024-07-04T01:47:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:46:00+00:00 exited with status queued for try_number 1 2024-07-04T01:47:01.165204772Z [2024-07-04T01:47:01.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:46:00+00:00 exited with status queued for try_number 1 2024-07-04T01:47:01.175204539Z [2024-07-04T01:47:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 057e19fb-e12d-4bc3-8982-e58c48445f30 2024-07-04T01:47:01.175270181Z [2024-07-04T01:47:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9de79b74-390b-4434-9dca-b51567a08e3d 2024-07-04T01:47:04.517517147Z [2024-07-04T01:47:04.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:47:04.517871517Z [2024-07-04T01:47:04.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:46:00+00:00, run_id=scheduled__2024-07-04T01:46:00+00:00, run_start_date=2024-07-04 01:47:00.932770+00:00, run_end_date=2024-07-04 01:47:04.517300+00:00, run_duration=3.58453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:46:00+00:00, data_interval_end=2024-07-04 01:47:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:47:04.526834117Z [2024-07-04T01:47:04.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:47:00+00:00, run_after=2024-07-04T01:48:00+00:00 2024-07-04T01:47:04.590195781Z [2024-07-04T01:47:04.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:46:00+00:00 exited with status success for try_number 1 2024-07-04T01:47:04.597581792Z [2024-07-04T01:47:04.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:46:00+00:00, map_index=-1, run_start_date=2024-07-04 01:47:02.817371+00:00, run_end_date=2024-07-04 01:47:04.104470+00:00, run_duration=1.287099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:47:00.982749+00:00, queued_by_job_id=2, pid=2039 2024-07-04T01:47:05.642281231Z [2024-07-04T01:47:05.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:47:05.642721913Z [2024-07-04T01:47:05.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:46:00+00:00, run_id=scheduled__2024-07-04T01:46:00+00:00, run_start_date=2024-07-04 01:47:00.931118+00:00, run_end_date=2024-07-04 01:47:05.642183+00:00, run_duration=4.711065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:46:00+00:00, data_interval_end=2024-07-04 01:47:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:47:05.657963095Z [2024-07-04T01:47:05.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:47:00+00:00, run_after=2024-07-04T01:48:00+00:00 2024-07-04T01:47:05.700330426Z [2024-07-04T01:47:05.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:46:00+00:00 exited with status success for try_number 1 2024-07-04T01:47:05.708056161Z [2024-07-04T01:47:05.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:46:00+00:00, map_index=-1, run_start_date=2024-07-04 01:47:02.816970+00:00, run_end_date=2024-07-04 01:47:04.692124+00:00, run_duration=1.875154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:47:00.982749+00:00, queued_by_job_id=2, pid=2040 2024-07-04T01:48:00.179622026Z [2024-07-04T01:48:00.178+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:48:00.208512391Z [2024-07-04T01:48:00.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:48:00+00:00, run_after=2024-07-04T01:49:00+00:00 2024-07-04T01:48:00.222209915Z [2024-07-04T01:48:00.221+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:48:00.285739604Z [2024-07-04T01:48:00.285+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:48:00.285771949Z 2024-07-04T01:48:00.285781919Z 2024-07-04T01:48:00.285785441Z 2024-07-04T01:48:00.286078925Z [2024-07-04T01:48:00.285+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:48:00.286282148Z [2024-07-04T01:48:00.286+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:48:00.286476710Z [2024-07-04T01:48:00.286+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:48:00.287183675Z [2024-07-04T01:48:00.286+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:48:00.287196612Z 2024-07-04T01:48:00.287200340Z 2024-07-04T01:48:00.287203677Z 2024-07-04T01:48:00.290759892Z [2024-07-04T01:48:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:48:00.291031816Z [2024-07-04T01:48:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:48:00.291384671Z [2024-07-04T01:48:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:48:00.291600137Z [2024-07-04T01:48:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:48:00.291915885Z [2024-07-04T01:48:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:48:00.292109510Z [2024-07-04T01:48:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:48:00.766399903Z [2024-07-04T01:48:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:46:00+00:00 exited with status queued for try_number 1 2024-07-04T01:48:00.767216825Z [2024-07-04T01:48:00.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:47:00+00:00 exited with status queued for try_number 1 2024-07-04T01:48:00.767437014Z [2024-07-04T01:48:00.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:47:00+00:00 exited with status queued for try_number 1 2024-07-04T01:48:00.779650321Z [2024-07-04T01:48:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c151564-f1bf-4fb9-8966-19edf3a65b6c 2024-07-04T01:48:00.779939104Z [2024-07-04T01:48:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to b250670a-2611-4fd7-9528-f4b8ce7a7bc0 2024-07-04T01:48:00.780175348Z [2024-07-04T01:48:00.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9fdb16f-fa43-4368-8905-447aa00418be 2024-07-04T01:48:02.740256513Z [2024-07-04T01:48:02.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:48:02.740569485Z [2024-07-04T01:48:02.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:46:00+00:00, run_id=scheduled__2024-07-04T01:46:00+00:00, run_start_date=2024-07-04 01:48:00.232722+00:00, run_end_date=2024-07-04 01:48:02.740183+00:00, run_duration=2.507461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:46:00+00:00, data_interval_end=2024-07-04 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:48:02.751094477Z [2024-07-04T01:48:02.750+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:48:00+00:00, run_after=2024-07-04T01:50:00+00:00 2024-07-04T01:48:02.798008367Z [2024-07-04T01:48:02.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:46:00+00:00 exited with status success for try_number 1 2024-07-04T01:48:02.805153521Z [2024-07-04T01:48:02.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:46:00+00:00, map_index=-1, run_start_date=2024-07-04 01:48:01.616901+00:00, run_end_date=2024-07-04 01:48:02.115435+00:00, run_duration=0.498534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:48:00.288132+00:00, queued_by_job_id=2, pid=2075 2024-07-04T01:48:04.962105147Z [2024-07-04T01:48:04.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:48:04.962495322Z [2024-07-04T01:48:04.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:47:00+00:00, run_id=scheduled__2024-07-04T01:47:00+00:00, run_start_date=2024-07-04 01:48:00.235278+00:00, run_end_date=2024-07-04 01:48:04.961969+00:00, run_duration=4.726691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:47:00+00:00, data_interval_end=2024-07-04 01:48:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:48:04.971123600Z [2024-07-04T01:48:04.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:48:00+00:00, run_after=2024-07-04T01:49:00+00:00 2024-07-04T01:48:04.976919764Z [2024-07-04T01:48:04.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:48:04.977323272Z [2024-07-04T01:48:04.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:47:00+00:00, run_id=scheduled__2024-07-04T01:47:00+00:00, run_start_date=2024-07-04 01:48:00.234173+00:00, run_end_date=2024-07-04 01:48:04.976804+00:00, run_duration=4.742631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:47:00+00:00, data_interval_end=2024-07-04 01:48:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:48:04.990601018Z [2024-07-04T01:48:04.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:48:00+00:00, run_after=2024-07-04T01:49:00+00:00 2024-07-04T01:48:05.024179234Z [2024-07-04T01:48:05.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:47:00+00:00 exited with status success for try_number 1 2024-07-04T01:48:05.024582339Z [2024-07-04T01:48:05.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:47:00+00:00 exited with status success for try_number 1 2024-07-04T01:48:05.031275004Z [2024-07-04T01:48:05.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:47:00+00:00, map_index=-1, run_start_date=2024-07-04 01:48:02.814270+00:00, run_end_date=2024-07-04 01:48:04.421552+00:00, run_duration=1.607282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:48:00.288132+00:00, queued_by_job_id=2, pid=2105 2024-07-04T01:48:05.031611802Z [2024-07-04T01:48:05.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:47:00+00:00, map_index=-1, run_start_date=2024-07-04 01:48:02.968096+00:00, run_end_date=2024-07-04 01:48:04.196420+00:00, run_duration=1.228324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:48:00.288132+00:00, queued_by_job_id=2, pid=2106 2024-07-04T01:49:01.065891953Z [2024-07-04T01:49:01.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:49:00+00:00, run_after=2024-07-04T01:50:00+00:00 2024-07-04T01:49:01.075989186Z [2024-07-04T01:49:01.075+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:49:01.150006689Z [2024-07-04T01:49:01.149+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:49:01.150054013Z 2024-07-04T01:49:01.150061060Z 2024-07-04T01:49:01.150195379Z [2024-07-04T01:49:01.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:49:01.150204201Z [2024-07-04T01:49:01.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:49:01.151149178Z [2024-07-04T01:49:01.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:49:01.151160902Z 2024-07-04T01:49:01.151166419Z 2024-07-04T01:49:01.155827918Z [2024-07-04T01:49:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:49:01.155967858Z [2024-07-04T01:49:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:49:01.156240006Z [2024-07-04T01:49:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:49:01.156378406Z [2024-07-04T01:49:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:49:01.321716207Z [2024-07-04T01:49:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:48:00+00:00 exited with status queued for try_number 1 2024-07-04T01:49:01.321859434Z [2024-07-04T01:49:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:48:00+00:00 exited with status queued for try_number 1 2024-07-04T01:49:01.331822787Z [2024-07-04T01:49:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to cea87a3b-edfb-4fd6-8986-d67b21ee6978 2024-07-04T01:49:01.331925104Z [2024-07-04T01:49:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60aac839-bf80-4b25-bc5f-9a2d46fead5a 2024-07-04T01:49:06.488683588Z [2024-07-04T01:49:06.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:49:06.488937485Z [2024-07-04T01:49:06.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:48:00+00:00, run_id=scheduled__2024-07-04T01:48:00+00:00, run_start_date=2024-07-04 01:49:01.087261+00:00, run_end_date=2024-07-04 01:49:06.488487+00:00, run_duration=5.401226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:48:00+00:00, data_interval_end=2024-07-04 01:49:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:49:06.502096342Z [2024-07-04T01:49:06.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:49:00+00:00, run_after=2024-07-04T01:50:00+00:00 2024-07-04T01:49:06.509346185Z [2024-07-04T01:49:06.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:49:06.509595822Z [2024-07-04T01:49:06.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:48:00+00:00, run_id=scheduled__2024-07-04T01:48:00+00:00, run_start_date=2024-07-04 01:49:01.088751+00:00, run_end_date=2024-07-04 01:49:06.509055+00:00, run_duration=5.420304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:48:00+00:00, data_interval_end=2024-07-04 01:49:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:49:06.522737664Z [2024-07-04T01:49:06.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:49:00+00:00, run_after=2024-07-04T01:50:00+00:00 2024-07-04T01:49:06.565398484Z [2024-07-04T01:49:06.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:48:00+00:00 exited with status success for try_number 1 2024-07-04T01:49:06.573180273Z [2024-07-04T01:49:06.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:48:00+00:00, map_index=-1, run_start_date=2024-07-04 01:49:03.160449+00:00, run_end_date=2024-07-04 01:49:06.078422+00:00, run_duration=2.917973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:49:01.152032+00:00, queued_by_job_id=2, pid=2161 2024-07-04T01:49:07.668378896Z [2024-07-04T01:49:07.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:48:00+00:00 exited with status success for try_number 1 2024-07-04T01:49:07.677213646Z [2024-07-04T01:49:07.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:48:00+00:00, map_index=-1, run_start_date=2024-07-04 01:49:03.109341+00:00, run_end_date=2024-07-04 01:49:06.401252+00:00, run_duration=3.291911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:49:01.152032+00:00, queued_by_job_id=2, pid=2160 2024-07-04T01:50:00.823461737Z [2024-07-04T01:50:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:50:00+00:00, run_after=2024-07-04T01:51:00+00:00 2024-07-04T01:50:00.832512567Z [2024-07-04T01:50:00.831+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:50:00.859243970Z [2024-07-04T01:50:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:50:00+00:00, run_after=2024-07-04T01:55:00+00:00 2024-07-04T01:50:00.870590962Z [2024-07-04T01:50:00.870+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:50:00.978894000Z [2024-07-04T01:50:00.978+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T01:50:00.978919962Z 2024-07-04T01:50:00.978923841Z 2024-07-04T01:50:00.978928161Z 2024-07-04T01:50:00.978931483Z 2024-07-04T01:50:00.979287370Z [2024-07-04T01:50:00.978+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:50:00.979554884Z [2024-07-04T01:50:00.979+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:50:00.979802692Z [2024-07-04T01:50:00.979+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:50:00.980001700Z [2024-07-04T01:50:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:50:00.980837263Z [2024-07-04T01:50:00.980+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:50:00.980850051Z 2024-07-04T01:50:00.980853954Z 2024-07-04T01:50:00.980857538Z 2024-07-04T01:50:00.980860811Z 2024-07-04T01:50:00.985564134Z [2024-07-04T01:50:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:50:00.985993879Z [2024-07-04T01:50:00.985+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:50:00.986359416Z [2024-07-04T01:50:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:50:00.986573773Z [2024-07-04T01:50:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:50:00.987022751Z [2024-07-04T01:50:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:50:00.987208405Z [2024-07-04T01:50:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:50:00.987612782Z [2024-07-04T01:50:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:50:00.987865534Z [2024-07-04T01:50:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:50:01.346347405Z [2024-07-04T01:50:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status queued for try_number 1 2024-07-04T01:50:01.348553095Z [2024-07-04T01:50:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:48:00+00:00 exited with status queued for try_number 1 2024-07-04T01:50:01.348720626Z [2024-07-04T01:50:01.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:49:00+00:00 exited with status queued for try_number 1 2024-07-04T01:50:01.348812775Z [2024-07-04T01:50:01.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:49:00+00:00 exited with status queued for try_number 1 2024-07-04T01:50:01.362171348Z [2024-07-04T01:50:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a220fce-3f14-44e4-9ced-e5d89ca9b20b 2024-07-04T01:50:01.362467193Z [2024-07-04T01:50:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf125bac-1d72-4792-a093-aa6919851c66 2024-07-04T01:50:01.362706025Z [2024-07-04T01:50:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to f62840a7-fd51-42f3-b071-40f35d3551f6 2024-07-04T01:50:01.363323321Z [2024-07-04T01:50:01.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d02de76-7c31-4b23-9fd0-99e4a1d465b3 2024-07-04T01:50:02.796402426Z [2024-07-04T01:50:02.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:50:02.796762448Z [2024-07-04T01:50:02.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:48:00+00:00, run_id=scheduled__2024-07-04T01:48:00+00:00, run_start_date=2024-07-04 01:50:00.887112+00:00, run_end_date=2024-07-04 01:50:02.796315+00:00, run_duration=1.909203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:48:00+00:00, data_interval_end=2024-07-04 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:50:02.817109735Z [2024-07-04T01:50:02.816+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:50:00+00:00, run_after=2024-07-04T01:52:00+00:00 2024-07-04T01:50:03.616616227Z [2024-07-04T01:50:03.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:48:00+00:00 exited with status success for try_number 1 2024-07-04T01:50:03.633008276Z [2024-07-04T01:50:03.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:48:00+00:00, map_index=-1, run_start_date=2024-07-04 01:50:02.313024+00:00, run_end_date=2024-07-04 01:50:02.749026+00:00, run_duration=0.436002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:50:00.982191+00:00, queued_by_job_id=2, pid=2197 2024-07-04T01:50:05.066284257Z [2024-07-04T01:50:05.065+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:50:05.066343719Z 2024-07-04T01:50:05.066461513Z [2024-07-04T01:50:05.066+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:50:05.067231574Z [2024-07-04T01:50:05.066+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:50:05.067276669Z 2024-07-04T01:50:05.070336243Z [2024-07-04T01:50:05.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T01:50:05.070464853Z [2024-07-04T01:50:05.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:50:05.120699118Z [2024-07-04T01:50:05.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status queued for try_number 1 2024-07-04T01:50:05.120978047Z [2024-07-04T01:50:05.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status success for try_number 1 2024-07-04T01:50:05.126411652Z [2024-07-04T01:50:05.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:45:00+00:00, map_index=-1, run_start_date=2024-07-04 01:50:03.435648+00:00, run_end_date=2024-07-04 01:50:03.944035+00:00, run_duration=0.508387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:50:00.982191+00:00, queued_by_job_id=2, pid=2239 2024-07-04T01:50:05.126786263Z [2024-07-04T01:50:05.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a5749f4-a1fe-4702-9749-b9dbd3b4198a 2024-07-04T01:50:06.274646971Z [2024-07-04T01:50:06.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:50:06.275352947Z [2024-07-04T01:50:06.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:49:00+00:00, run_id=scheduled__2024-07-04T01:49:00+00:00, run_start_date=2024-07-04 01:50:00.889239+00:00, run_end_date=2024-07-04 01:50:06.274654+00:00, run_duration=5.385415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:49:00+00:00, data_interval_end=2024-07-04 01:50:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:50:06.290105313Z [2024-07-04T01:50:06.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:50:00+00:00, run_after=2024-07-04T01:51:00+00:00 2024-07-04T01:50:06.298769179Z [2024-07-04T01:50:06.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:50:06.299119746Z [2024-07-04T01:50:06.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:49:00+00:00, run_id=scheduled__2024-07-04T01:49:00+00:00, run_start_date=2024-07-04 01:50:00.891342+00:00, run_end_date=2024-07-04 01:50:06.298744+00:00, run_duration=5.407402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:49:00+00:00, data_interval_end=2024-07-04 01:50:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:50:06.309062213Z [2024-07-04T01:50:06.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:50:00+00:00, run_after=2024-07-04T01:51:00+00:00 2024-07-04T01:50:06.371462153Z [2024-07-04T01:50:06.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:49:00+00:00 exited with status success for try_number 1 2024-07-04T01:50:06.371727799Z [2024-07-04T01:50:06.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:49:00+00:00 exited with status success for try_number 1 2024-07-04T01:50:06.384284749Z [2024-07-04T01:50:06.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:49:00+00:00, map_index=-1, run_start_date=2024-07-04 01:50:03.376324+00:00, run_end_date=2024-07-04 01:50:05.058267+00:00, run_duration=1.681943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:50:00.982191+00:00, queued_by_job_id=2, pid=2237 2024-07-04T01:50:06.384695953Z [2024-07-04T01:50:06.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:49:00+00:00, map_index=-1, run_start_date=2024-07-04 01:50:03.392892+00:00, run_end_date=2024-07-04 01:50:05.303261+00:00, run_duration=1.910369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:50:00.982191+00:00, queued_by_job_id=2, pid=2238 2024-07-04T01:50:07.488981812Z [2024-07-04T01:50:07.488+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:50:07.489029757Z 2024-07-04T01:50:07.489414977Z [2024-07-04T01:50:07.489+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:50:07.490757204Z [2024-07-04T01:50:07.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:50:07.490783014Z 2024-07-04T01:50:07.495441174Z [2024-07-04T01:50:07.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T01:50:07.495937131Z [2024-07-04T01:50:07.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:50:07.568661897Z [2024-07-04T01:50:07.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status queued for try_number 1 2024-07-04T01:50:07.568977269Z [2024-07-04T01:50:07.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status success for try_number 1 2024-07-04T01:50:07.580181503Z [2024-07-04T01:50:07.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b335a8c-f4ff-4c10-99b5-eb9a8108d843 2024-07-04T01:50:07.580855227Z [2024-07-04T01:50:07.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T01:45:00+00:00, map_index=-1, run_start_date=2024-07-04 01:50:06.819978+00:00, run_end_date=2024-07-04 01:50:07.228842+00:00, run_duration=0.408864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:50:05.067578+00:00, queued_by_job_id=2, pid=2277 2024-07-04T01:50:10.165633061Z [2024-07-04T01:50:10.165+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:50:10.165668797Z 2024-07-04T01:50:10.165711150Z [2024-07-04T01:50:10.165+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:50:10.166452393Z [2024-07-04T01:50:10.166+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:50:10.166463577Z 2024-07-04T01:50:10.171244943Z [2024-07-04T01:50:10.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:50:10.171408151Z [2024-07-04T01:50:10.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:50:10.240100585Z [2024-07-04T01:50:10.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status queued for try_number 1 2024-07-04T01:50:10.240165937Z [2024-07-04T01:50:10.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status success for try_number 1 2024-07-04T01:50:10.248208472Z [2024-07-04T01:50:10.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5f343c8-ebfc-4340-ac23-7d97493bf73a 2024-07-04T01:50:10.248573935Z [2024-07-04T01:50:10.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T01:45:00+00:00, map_index=0, run_start_date=2024-07-04 01:50:09.153907+00:00, run_end_date=2024-07-04 01:50:09.565613+00:00, run_duration=0.411706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:50:07.491515+00:00, queued_by_job_id=2, pid=2289 2024-07-04T01:50:12.478503029Z [2024-07-04T01:50:12.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:50:12.478822520Z [2024-07-04T01:50:12.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:45:00+00:00, run_id=scheduled__2024-07-04T01:45:00+00:00, run_start_date=2024-07-04 01:50:00.885350+00:00, run_end_date=2024-07-04 01:50:12.478336+00:00, run_duration=11.592986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:45:00+00:00, data_interval_end=2024-07-04 01:50:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T01:50:12.489572993Z [2024-07-04T01:50:12.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:50:00+00:00, run_after=2024-07-04T01:55:00+00:00 2024-07-04T01:50:12.519836698Z [2024-07-04T01:50:12.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:45:00+00:00 exited with status success for try_number 1 2024-07-04T01:50:12.527066368Z [2024-07-04T01:50:12.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T01:45:00+00:00, map_index=-1, run_start_date=2024-07-04 01:50:11.887905+00:00, run_end_date=2024-07-04 01:50:12.323933+00:00, run_duration=0.436028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:50:10.166863+00:00, queued_by_job_id=2, pid=2301 2024-07-04T01:51:00.893603127Z [2024-07-04T01:51:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:51:00+00:00, run_after=2024-07-04T01:52:00+00:00 2024-07-04T01:51:00.917534939Z [2024-07-04T01:51:00.917+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:51:01.013337160Z [2024-07-04T01:51:01.012+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:51:01.013365886Z 2024-07-04T01:51:01.013370906Z 2024-07-04T01:51:01.013569873Z [2024-07-04T01:51:01.013+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:51:01.013754227Z [2024-07-04T01:51:01.013+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:51:01.014549272Z [2024-07-04T01:51:01.014+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:51:01.014560756Z 2024-07-04T01:51:01.014564837Z 2024-07-04T01:51:01.017971902Z [2024-07-04T01:51:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:51:01.018214912Z [2024-07-04T01:51:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:51:01.018550405Z [2024-07-04T01:51:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:51:01.018733362Z [2024-07-04T01:51:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:51:01.232805995Z [2024-07-04T01:51:01.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status queued for try_number 1 2024-07-04T01:51:01.232958843Z [2024-07-04T01:51:01.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status queued for try_number 1 2024-07-04T01:51:01.251467229Z [2024-07-04T01:51:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b1efa4e-d95e-4e62-ac90-91d363722fdc 2024-07-04T01:51:01.251724335Z [2024-07-04T01:51:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8aefeeea-8b17-412e-8ce8-d1c158c6cceb 2024-07-04T01:51:06.016551990Z [2024-07-04T01:51:06.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:51:06.017119102Z [2024-07-04T01:51:06.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:50:00+00:00, run_id=scheduled__2024-07-04T01:50:00+00:00, run_start_date=2024-07-04 01:51:00.934366+00:00, run_end_date=2024-07-04 01:51:06.016708+00:00, run_duration=5.082342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:50:00+00:00, data_interval_end=2024-07-04 01:51:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:51:06.032194682Z [2024-07-04T01:51:06.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:51:00+00:00, run_after=2024-07-04T01:52:00+00:00 2024-07-04T01:51:06.046734055Z [2024-07-04T01:51:06.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:51:06.047493238Z [2024-07-04T01:51:06.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:50:00+00:00, run_id=scheduled__2024-07-04T01:50:00+00:00, run_start_date=2024-07-04 01:51:00.937886+00:00, run_end_date=2024-07-04 01:51:06.047150+00:00, run_duration=5.109264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:50:00+00:00, data_interval_end=2024-07-04 01:51:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:51:06.060109224Z [2024-07-04T01:51:06.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:51:00+00:00, run_after=2024-07-04T01:52:00+00:00 2024-07-04T01:51:06.112233298Z [2024-07-04T01:51:06.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status success for try_number 1 2024-07-04T01:51:06.112572372Z [2024-07-04T01:51:06.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status success for try_number 1 2024-07-04T01:51:06.119800922Z [2024-07-04T01:51:06.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:50:00+00:00, map_index=-1, run_start_date=2024-07-04 01:51:02.921387+00:00, run_end_date=2024-07-04 01:51:05.021397+00:00, run_duration=2.10001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:51:01.015387+00:00, queued_by_job_id=2, pid=2337 2024-07-04T01:51:06.120212748Z [2024-07-04T01:51:06.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:50:00+00:00, map_index=-1, run_start_date=2024-07-04 01:51:02.972643+00:00, run_end_date=2024-07-04 01:51:05.382168+00:00, run_duration=2.409525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:51:01.015387+00:00, queued_by_job_id=2, pid=2338 2024-07-04T01:51:21.158350590Z [2024-07-04T01:51:21.157+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T01:52:00.071542908Z [2024-07-04T01:52:00.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:52:00.093324066Z [2024-07-04T01:52:00.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:52:00+00:00, run_after=2024-07-04T01:53:00+00:00 2024-07-04T01:52:00.102902465Z [2024-07-04T01:52:00.102+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:52:00.215041524Z [2024-07-04T01:52:00.214+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:52:00.215092541Z 2024-07-04T01:52:00.215098056Z 2024-07-04T01:52:00.215102317Z 2024-07-04T01:52:00.215184729Z [2024-07-04T01:52:00.214+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:52:00.215301623Z [2024-07-04T01:52:00.215+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:52:00.215435750Z [2024-07-04T01:52:00.215+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:52:00.216285625Z [2024-07-04T01:52:00.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:52:00.216298497Z 2024-07-04T01:52:00.216303103Z 2024-07-04T01:52:00.216307229Z 2024-07-04T01:52:00.220998230Z [2024-07-04T01:52:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:52:00.221167506Z [2024-07-04T01:52:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:52:00.221464619Z [2024-07-04T01:52:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:52:00.221594982Z [2024-07-04T01:52:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:52:00.221864270Z [2024-07-04T01:52:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:52:00.221992743Z [2024-07-04T01:52:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:52:00.657171498Z [2024-07-04T01:52:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status queued for try_number 1 2024-07-04T01:52:00.659416516Z [2024-07-04T01:52:00.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:51:00+00:00 exited with status queued for try_number 1 2024-07-04T01:52:00.659688045Z [2024-07-04T01:52:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:51:00+00:00 exited with status queued for try_number 1 2024-07-04T01:52:00.676965952Z [2024-07-04T01:52:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28066b6b-b398-42ff-9fb0-38d5a39c72e9 2024-07-04T01:52:00.677188422Z [2024-07-04T01:52:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01ac2461-ac85-487b-9995-0ef07e6d716c 2024-07-04T01:52:00.677425940Z [2024-07-04T01:52:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecd3a54b-374f-4cff-adb1-b3672cde395b 2024-07-04T01:52:03.079566061Z [2024-07-04T01:52:03.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:52:03.080036399Z [2024-07-04T01:52:03.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:50:00+00:00, run_id=scheduled__2024-07-04T01:50:00+00:00, run_start_date=2024-07-04 01:52:00.119371+00:00, run_end_date=2024-07-04 01:52:03.079622+00:00, run_duration=2.960251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:50:00+00:00, data_interval_end=2024-07-04 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:52:03.110390340Z [2024-07-04T01:52:03.109+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:52:00+00:00, run_after=2024-07-04T01:54:00+00:00 2024-07-04T01:52:03.189296014Z [2024-07-04T01:52:03.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status success for try_number 1 2024-07-04T01:52:03.194344785Z [2024-07-04T01:52:03.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:50:00+00:00, map_index=-1, run_start_date=2024-07-04 01:52:01.900782+00:00, run_end_date=2024-07-04 01:52:02.552415+00:00, run_duration=0.651633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:52:00.217406+00:00, queued_by_job_id=2, pid=2373 2024-07-04T01:52:05.646953227Z [2024-07-04T01:52:05.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:52:05.648107059Z [2024-07-04T01:52:05.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:51:00+00:00, run_id=scheduled__2024-07-04T01:51:00+00:00, run_start_date=2024-07-04 01:52:00.121838+00:00, run_end_date=2024-07-04 01:52:05.646702+00:00, run_duration=5.524864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:51:00+00:00, data_interval_end=2024-07-04 01:52:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:52:05.665616787Z [2024-07-04T01:52:05.664+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:52:00+00:00, run_after=2024-07-04T01:53:00+00:00 2024-07-04T01:52:05.719609323Z [2024-07-04T01:52:05.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:51:00+00:00 exited with status success for try_number 1 2024-07-04T01:52:05.719773595Z [2024-07-04T01:52:05.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:51:00+00:00 exited with status success for try_number 1 2024-07-04T01:52:05.729124360Z [2024-07-04T01:52:05.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:51:00+00:00, map_index=-1, run_start_date=2024-07-04 01:52:02.944792+00:00, run_end_date=2024-07-04 01:52:05.525382+00:00, run_duration=2.58059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:52:00.217406+00:00, queued_by_job_id=2, pid=2393 2024-07-04T01:52:05.729294875Z [2024-07-04T01:52:05.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:51:00+00:00, map_index=-1, run_start_date=2024-07-04 01:52:03.260183+00:00, run_end_date=2024-07-04 01:52:05.208058+00:00, run_duration=1.947875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:52:00.217406+00:00, queued_by_job_id=2, pid=2403 2024-07-04T01:52:05.936647956Z [2024-07-04T01:52:05.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:52:05.937228626Z [2024-07-04T01:52:05.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:51:00+00:00, run_id=scheduled__2024-07-04T01:51:00+00:00, run_start_date=2024-07-04 01:52:00.120832+00:00, run_end_date=2024-07-04 01:52:05.936533+00:00, run_duration=5.815701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:51:00+00:00, data_interval_end=2024-07-04 01:52:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:52:05.956883872Z [2024-07-04T01:52:05.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:52:00+00:00, run_after=2024-07-04T01:53:00+00:00 2024-07-04T01:53:00.364555758Z [2024-07-04T01:53:00.363+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:53:00.378977564Z [2024-07-04T01:53:00.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:53:00+00:00, run_after=2024-07-04T01:54:00+00:00 2024-07-04T01:53:00.446917478Z [2024-07-04T01:53:00.446+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:53:00.446944396Z 2024-07-04T01:53:00.446949544Z 2024-07-04T01:53:00.447121860Z [2024-07-04T01:53:00.446+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:53:00.447235568Z [2024-07-04T01:53:00.447+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:53:00.447987090Z [2024-07-04T01:53:00.447+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:53:00.448002382Z 2024-07-04T01:53:00.448024352Z 2024-07-04T01:53:00.452818151Z [2024-07-04T01:53:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:53:00.452985646Z [2024-07-04T01:53:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:53:00.453220351Z [2024-07-04T01:53:00.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:53:00.453331889Z [2024-07-04T01:53:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:53:00.840987316Z [2024-07-04T01:53:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:52:00+00:00 exited with status queued for try_number 1 2024-07-04T01:53:00.841201991Z [2024-07-04T01:53:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:52:00+00:00 exited with status queued for try_number 1 2024-07-04T01:53:00.861576480Z [2024-07-04T01:53:00.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0a262cf-3393-445e-86df-56d43c40a90d 2024-07-04T01:53:00.861794583Z [2024-07-04T01:53:00.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77cfd142-fdff-48d0-a442-2e7a1b01e130 2024-07-04T01:53:04.175409925Z [2024-07-04T01:53:04.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:53:04.179620188Z [2024-07-04T01:53:04.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:52:00+00:00, run_id=scheduled__2024-07-04T01:52:00+00:00, run_start_date=2024-07-04 01:53:00.394845+00:00, run_end_date=2024-07-04 01:53:04.175240+00:00, run_duration=3.780395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:52:00+00:00, data_interval_end=2024-07-04 01:53:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:53:04.194791299Z [2024-07-04T01:53:04.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:53:00+00:00, run_after=2024-07-04T01:54:00+00:00 2024-07-04T01:53:04.205465088Z [2024-07-04T01:53:04.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:53:04.209800722Z [2024-07-04T01:53:04.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:52:00+00:00, run_id=scheduled__2024-07-04T01:52:00+00:00, run_start_date=2024-07-04 01:53:00.397299+00:00, run_end_date=2024-07-04 01:53:04.209172+00:00, run_duration=3.811873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:52:00+00:00, data_interval_end=2024-07-04 01:53:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:53:04.221573072Z [2024-07-04T01:53:04.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:53:00+00:00, run_after=2024-07-04T01:54:00+00:00 2024-07-04T01:53:04.260053642Z [2024-07-04T01:53:04.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:52:00+00:00 exited with status success for try_number 1 2024-07-04T01:53:04.260146946Z [2024-07-04T01:53:04.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:52:00+00:00 exited with status success for try_number 1 2024-07-04T01:53:04.272149211Z [2024-07-04T01:53:04.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:52:00+00:00, map_index=-1, run_start_date=2024-07-04 01:53:02.356893+00:00, run_end_date=2024-07-04 01:53:03.990586+00:00, run_duration=1.633693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:53:00.448947+00:00, queued_by_job_id=2, pid=2456 2024-07-04T01:53:04.272459615Z [2024-07-04T01:53:04.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:52:00+00:00, map_index=-1, run_start_date=2024-07-04 01:53:02.403204+00:00, run_end_date=2024-07-04 01:53:04.063655+00:00, run_duration=1.660451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:53:00.448947+00:00, queued_by_job_id=2, pid=2457 2024-07-04T01:54:00.627728314Z [2024-07-04T01:54:00.627+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:54:00.642395708Z [2024-07-04T01:54:00.642+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:54:00.656017897Z [2024-07-04T01:54:00.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:54:00+00:00, run_after=2024-07-04T01:55:00+00:00 2024-07-04T01:54:00.728214191Z [2024-07-04T01:54:00.727+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:54:00.728239083Z 2024-07-04T01:54:00.728243614Z 2024-07-04T01:54:00.728246928Z 2024-07-04T01:54:00.728517602Z [2024-07-04T01:54:00.728+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:54:00.728678590Z [2024-07-04T01:54:00.728+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:54:00.728837170Z [2024-07-04T01:54:00.728+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:54:00.729548252Z [2024-07-04T01:54:00.729+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:54:00.729561324Z 2024-07-04T01:54:00.729565954Z 2024-07-04T01:54:00.729570326Z 2024-07-04T01:54:00.734470819Z [2024-07-04T01:54:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:54:00.735201353Z [2024-07-04T01:54:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:54:00.735529071Z [2024-07-04T01:54:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:54:00.735697340Z [2024-07-04T01:54:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:54:00.736072214Z [2024-07-04T01:54:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:54:00.736512306Z [2024-07-04T01:54:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:54:01.108932901Z [2024-07-04T01:54:01.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:52:00+00:00 exited with status queued for try_number 1 2024-07-04T01:54:01.109165797Z [2024-07-04T01:54:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:53:00+00:00 exited with status queued for try_number 1 2024-07-04T01:54:01.109327582Z [2024-07-04T01:54:01.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:53:00+00:00 exited with status queued for try_number 1 2024-07-04T01:54:01.116732749Z [2024-07-04T01:54:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce1dcccb-0bce-4436-b4c6-a337c301b3ce 2024-07-04T01:54:01.116874277Z [2024-07-04T01:54:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f18fde0-6d38-428b-a7a6-963469407dd2 2024-07-04T01:54:01.117026419Z [2024-07-04T01:54:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60fd9ced-7e77-4703-876b-93a88f96d9e3 2024-07-04T01:54:02.278254071Z [2024-07-04T01:54:02.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:54:02.278677660Z [2024-07-04T01:54:02.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:52:00+00:00, run_id=scheduled__2024-07-04T01:52:00+00:00, run_start_date=2024-07-04 01:54:00.668717+00:00, run_end_date=2024-07-04 01:54:02.278246+00:00, run_duration=1.609529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:52:00+00:00, data_interval_end=2024-07-04 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:54:02.286534060Z [2024-07-04T01:54:02.286+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:54:00+00:00, run_after=2024-07-04T01:56:00+00:00 2024-07-04T01:54:02.351427248Z [2024-07-04T01:54:02.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:52:00+00:00 exited with status success for try_number 1 2024-07-04T01:54:02.357257967Z [2024-07-04T01:54:02.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:52:00+00:00, map_index=-1, run_start_date=2024-07-04 01:54:01.583566+00:00, run_end_date=2024-07-04 01:54:02.147951+00:00, run_duration=0.564385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:54:00.730556+00:00, queued_by_job_id=2, pid=2492 2024-07-04T01:54:03.965225322Z [2024-07-04T01:54:03.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:54:03.965491430Z [2024-07-04T01:54:03.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:53:00+00:00, run_id=scheduled__2024-07-04T01:53:00+00:00, run_start_date=2024-07-04 01:54:00.672236+00:00, run_end_date=2024-07-04 01:54:03.965133+00:00, run_duration=3.292897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:53:00+00:00, data_interval_end=2024-07-04 01:54:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:54:03.976254972Z [2024-07-04T01:54:03.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:54:00+00:00, run_after=2024-07-04T01:55:00+00:00 2024-07-04T01:54:04.026024006Z [2024-07-04T01:54:04.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:53:00+00:00 exited with status success for try_number 1 2024-07-04T01:54:04.032719916Z [2024-07-04T01:54:04.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:53:00+00:00, map_index=-1, run_start_date=2024-07-04 01:54:02.555703+00:00, run_end_date=2024-07-04 01:54:03.779872+00:00, run_duration=1.224169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:54:00.730556+00:00, queued_by_job_id=2, pid=2522 2024-07-04T01:54:05.084997176Z [2024-07-04T01:54:05.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:54:05.085228848Z [2024-07-04T01:54:05.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:53:00+00:00, run_id=scheduled__2024-07-04T01:53:00+00:00, run_start_date=2024-07-04 01:54:00.670376+00:00, run_end_date=2024-07-04 01:54:05.084884+00:00, run_duration=4.414508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:53:00+00:00, data_interval_end=2024-07-04 01:54:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:54:05.095365653Z [2024-07-04T01:54:05.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:54:00+00:00, run_after=2024-07-04T01:55:00+00:00 2024-07-04T01:54:05.135018034Z [2024-07-04T01:54:05.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:53:00+00:00 exited with status success for try_number 1 2024-07-04T01:54:05.144196605Z [2024-07-04T01:54:05.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:53:00+00:00, map_index=-1, run_start_date=2024-07-04 01:54:02.603781+00:00, run_end_date=2024-07-04 01:54:04.325558+00:00, run_duration=1.721777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:54:00.730556+00:00, queued_by_job_id=2, pid=2523 2024-07-04T01:55:00.860394016Z [2024-07-04T01:55:00.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:55:00+00:00, run_after=2024-07-04T02:00:00+00:00 2024-07-04T01:55:00.894247892Z [2024-07-04T01:55:00.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:55:00+00:00, run_after=2024-07-04T01:56:00+00:00 2024-07-04T01:55:00.904985968Z [2024-07-04T01:55:00.904+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:55:00.982290220Z [2024-07-04T01:55:00.981+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:55:00.982340933Z 2024-07-04T01:55:00.982353312Z 2024-07-04T01:55:00.982363477Z 2024-07-04T01:55:00.982403409Z [2024-07-04T01:55:00.982+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:55:00.982719840Z [2024-07-04T01:55:00.982+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:55:00.983256348Z [2024-07-04T01:55:00.982+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:55:00.984926459Z [2024-07-04T01:55:00.984+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:55:00.984944225Z 2024-07-04T01:55:00.984953876Z 2024-07-04T01:55:00.984960880Z 2024-07-04T01:55:00.993979127Z [2024-07-04T01:55:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T01:55:00.994405302Z [2024-07-04T01:55:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:55:00.994958986Z [2024-07-04T01:55:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:55:00.995354416Z [2024-07-04T01:55:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:55:00.995905701Z [2024-07-04T01:55:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:55:00.996227651Z [2024-07-04T01:55:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:55:01.249879534Z [2024-07-04T01:55:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status queued for try_number 1 2024-07-04T01:55:01.252244683Z [2024-07-04T01:55:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:54:00+00:00 exited with status queued for try_number 1 2024-07-04T01:55:01.252472288Z [2024-07-04T01:55:01.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:54:00+00:00 exited with status queued for try_number 1 2024-07-04T01:55:01.269102990Z [2024-07-04T01:55:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d076940-cc26-4254-b612-45e7fb6d89b9 2024-07-04T01:55:01.269518449Z [2024-07-04T01:55:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d721228-e52e-4693-9c51-09ed48b2e5bd 2024-07-04T01:55:01.269890346Z [2024-07-04T01:55:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to e70a0991-d3f1-4ecf-af28-39c4bccb3ae9 2024-07-04T01:55:03.855400740Z [2024-07-04T01:55:03.854+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:55:03.855438061Z 2024-07-04T01:55:03.855693677Z [2024-07-04T01:55:03.855+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:55:03.856726002Z [2024-07-04T01:55:03.856+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:55:03.856785003Z 2024-07-04T01:55:03.859922821Z [2024-07-04T01:55:03.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T01:55:03.860283790Z [2024-07-04T01:55:03.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:55:03.932082447Z [2024-07-04T01:55:03.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status queued for try_number 1 2024-07-04T01:55:03.932948558Z [2024-07-04T01:55:03.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status success for try_number 1 2024-07-04T01:55:03.939903477Z [2024-07-04T01:55:03.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to acad2a09-41d2-43ab-9410-97d7b2b4fab9 2024-07-04T01:55:03.940313316Z [2024-07-04T01:55:03.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:50:00+00:00, map_index=-1, run_start_date=2024-07-04 01:55:03.176234+00:00, run_end_date=2024-07-04 01:55:03.594333+00:00, run_duration=0.418099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:55:00.988812+00:00, queued_by_job_id=2, pid=2589 2024-07-04T01:55:05.146659835Z [2024-07-04T01:55:05.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:55:05.146956535Z [2024-07-04T01:55:05.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:54:00+00:00, run_id=scheduled__2024-07-04T01:54:00+00:00, run_start_date=2024-07-04 01:55:00.917222+00:00, run_end_date=2024-07-04 01:55:05.146492+00:00, run_duration=4.22927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:54:00+00:00, data_interval_end=2024-07-04 01:55:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:55:05.159967885Z [2024-07-04T01:55:05.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:55:00+00:00, run_after=2024-07-04T01:56:00+00:00 2024-07-04T01:55:05.168473253Z [2024-07-04T01:55:05.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:55:05.168576385Z [2024-07-04T01:55:05.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:54:00+00:00, run_id=scheduled__2024-07-04T01:54:00+00:00, run_start_date=2024-07-04 01:55:00.918445+00:00, run_end_date=2024-07-04 01:55:05.168304+00:00, run_duration=4.249859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:54:00+00:00, data_interval_end=2024-07-04 01:55:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:55:05.178084661Z [2024-07-04T01:55:05.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:55:00+00:00, run_after=2024-07-04T01:56:00+00:00 2024-07-04T01:55:05.242614099Z [2024-07-04T01:55:05.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:54:00+00:00 exited with status success for try_number 1 2024-07-04T01:55:05.242748742Z [2024-07-04T01:55:05.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:54:00+00:00 exited with status success for try_number 1 2024-07-04T01:55:05.252413559Z [2024-07-04T01:55:05.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:54:00+00:00, map_index=-1, run_start_date=2024-07-04 01:55:02.888255+00:00, run_end_date=2024-07-04 01:55:04.444751+00:00, run_duration=1.556496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:55:00.988812+00:00, queued_by_job_id=2, pid=2579 2024-07-04T01:55:05.252665351Z [2024-07-04T01:55:05.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:54:00+00:00, map_index=-1, run_start_date=2024-07-04 01:55:03.048820+00:00, run_end_date=2024-07-04 01:55:04.822923+00:00, run_duration=1.774103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:55:00.988812+00:00, queued_by_job_id=2, pid=2588 2024-07-04T01:55:06.906513243Z [2024-07-04T01:55:06.906+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:55:06.906557754Z 2024-07-04T01:55:06.907119464Z [2024-07-04T01:55:06.906+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:55:06.908425736Z [2024-07-04T01:55:06.908+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:55:06.908448531Z 2024-07-04T01:55:06.912225343Z [2024-07-04T01:55:06.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T01:55:06.912645292Z [2024-07-04T01:55:06.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:55:06.985752964Z [2024-07-04T01:55:06.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status queued for try_number 1 2024-07-04T01:55:06.986483163Z [2024-07-04T01:55:06.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status success for try_number 1 2024-07-04T01:55:06.996893415Z [2024-07-04T01:55:06.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0ca3161-c33e-4cf9-b262-52392a9a4261 2024-07-04T01:55:06.997266033Z [2024-07-04T01:55:06.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T01:50:00+00:00, map_index=-1, run_start_date=2024-07-04 01:55:05.540154+00:00, run_end_date=2024-07-04 01:55:05.935488+00:00, run_duration=0.395334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:55:03.857199+00:00, queued_by_job_id=2, pid=2628 2024-07-04T01:55:09.046432644Z [2024-07-04T01:55:09.046+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T01:55:09.046471162Z 2024-07-04T01:55:09.046483955Z [2024-07-04T01:55:09.046+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:55:09.047021510Z [2024-07-04T01:55:09.046+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:55:09.047038638Z 2024-07-04T01:55:09.049204242Z [2024-07-04T01:55:09.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:55:09.049245204Z [2024-07-04T01:55:09.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:55:09.100185051Z [2024-07-04T01:55:09.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status queued for try_number 1 2024-07-04T01:55:09.107547987Z [2024-07-04T01:55:09.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fd0395c-1395-43b5-bc3b-f76d97d70736 2024-07-04T01:55:09.188973783Z [2024-07-04T01:55:09.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status success for try_number 1 2024-07-04T01:55:09.195465013Z [2024-07-04T01:55:09.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T01:50:00+00:00, map_index=0, run_start_date=2024-07-04 01:55:08.585263+00:00, run_end_date=2024-07-04 01:55:08.941847+00:00, run_duration=0.356584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:55:06.909111+00:00, queued_by_job_id=2, pid=2640 2024-07-04T01:55:11.352040106Z [2024-07-04T01:55:11.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:55:11.352325321Z [2024-07-04T01:55:11.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:50:00+00:00, run_id=scheduled__2024-07-04T01:50:00+00:00, run_start_date=2024-07-04 01:55:00.915738+00:00, run_end_date=2024-07-04 01:55:11.351871+00:00, run_duration=10.436133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:50:00+00:00, data_interval_end=2024-07-04 01:55:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T01:55:11.360058691Z [2024-07-04T01:55:11.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:55:00+00:00, run_after=2024-07-04T02:00:00+00:00 2024-07-04T01:55:11.413966511Z [2024-07-04T01:55:11.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:50:00+00:00 exited with status success for try_number 1 2024-07-04T01:55:11.421724121Z [2024-07-04T01:55:11.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T01:50:00+00:00, map_index=-1, run_start_date=2024-07-04 01:55:10.706009+00:00, run_end_date=2024-07-04 01:55:11.107243+00:00, run_duration=0.401234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:55:09.047342+00:00, queued_by_job_id=2, pid=2652 2024-07-04T01:56:00.956287886Z [2024-07-04T01:56:00.955+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:56:00.963277256Z [2024-07-04T01:56:00.962+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:56:00.975241725Z [2024-07-04T01:56:00.974+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:56:00+00:00, run_after=2024-07-04T01:57:00+00:00 2024-07-04T01:56:01.044434843Z [2024-07-04T01:56:01.044+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:56:01.044466751Z 2024-07-04T01:56:01.044475049Z 2024-07-04T01:56:01.044480487Z 2024-07-04T01:56:01.044571298Z [2024-07-04T01:56:01.044+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:56:01.044579003Z [2024-07-04T01:56:01.044+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:56:01.044647607Z [2024-07-04T01:56:01.044+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:56:01.045241977Z [2024-07-04T01:56:01.045+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:56:01.045256868Z 2024-07-04T01:56:01.045261932Z 2024-07-04T01:56:01.045266349Z 2024-07-04T01:56:01.048689831Z [2024-07-04T01:56:01.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:56:01.048800193Z [2024-07-04T01:56:01.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:56:01.049053739Z [2024-07-04T01:56:01.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:56:01.049157593Z [2024-07-04T01:56:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:56:01.049409068Z [2024-07-04T01:56:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:56:01.049515669Z [2024-07-04T01:56:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:56:01.358625000Z [2024-07-04T01:56:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:54:00+00:00 exited with status queued for try_number 1 2024-07-04T01:56:01.360643783Z [2024-07-04T01:56:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status queued for try_number 1 2024-07-04T01:56:01.360780561Z [2024-07-04T01:56:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status queued for try_number 1 2024-07-04T01:56:01.368672739Z [2024-07-04T01:56:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdca15a7-2c3c-4248-91c5-c731696f4899 2024-07-04T01:56:01.368964830Z [2024-07-04T01:56:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 750bbc0f-6cab-4e8d-a2c8-3567a00f51a7 2024-07-04T01:56:01.369168825Z [2024-07-04T01:56:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ccd73b7-1835-4048-b3c1-efad77026326 2024-07-04T01:56:02.534080173Z [2024-07-04T01:56:02.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:56:02.534625717Z [2024-07-04T01:56:02.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:54:00+00:00, run_id=scheduled__2024-07-04T01:54:00+00:00, run_start_date=2024-07-04 01:56:00.986469+00:00, run_end_date=2024-07-04 01:56:02.534246+00:00, run_duration=1.547777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:54:00+00:00, data_interval_end=2024-07-04 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:56:02.542575200Z [2024-07-04T01:56:02.542+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:56:00+00:00, run_after=2024-07-04T01:58:00+00:00 2024-07-04T01:56:02.604194073Z [2024-07-04T01:56:02.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:54:00+00:00 exited with status success for try_number 1 2024-07-04T01:56:02.614292804Z [2024-07-04T01:56:02.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:54:00+00:00, map_index=-1, run_start_date=2024-07-04 01:56:01.893082+00:00, run_end_date=2024-07-04 01:56:02.307840+00:00, run_duration=0.414758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:56:01.045990+00:00, queued_by_job_id=2, pid=2669 2024-07-04T01:56:04.802946365Z [2024-07-04T01:56:04.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:56:04.802972021Z [2024-07-04T01:56:04.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:55:00+00:00, run_id=scheduled__2024-07-04T01:55:00+00:00, run_start_date=2024-07-04 01:56:00.989080+00:00, run_end_date=2024-07-04 01:56:04.802543+00:00, run_duration=3.813463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:55:00+00:00, data_interval_end=2024-07-04 01:56:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:56:04.812147442Z [2024-07-04T01:56:04.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:56:00+00:00, run_after=2024-07-04T01:57:00+00:00 2024-07-04T01:56:04.851751350Z [2024-07-04T01:56:04.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status success for try_number 1 2024-07-04T01:56:04.861442937Z [2024-07-04T01:56:04.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:55:00+00:00, map_index=-1, run_start_date=2024-07-04 01:56:02.818260+00:00, run_end_date=2024-07-04 01:56:04.258533+00:00, run_duration=1.440273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:56:01.045990+00:00, queued_by_job_id=2, pid=2699 2024-07-04T01:56:04.970859038Z [2024-07-04T01:56:04.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:56:04.971145835Z [2024-07-04T01:56:04.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:55:00+00:00, run_id=scheduled__2024-07-04T01:55:00+00:00, run_start_date=2024-07-04 01:56:00.987963+00:00, run_end_date=2024-07-04 01:56:04.970755+00:00, run_duration=3.982792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:55:00+00:00, data_interval_end=2024-07-04 01:56:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:56:04.980586046Z [2024-07-04T01:56:04.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:56:00+00:00, run_after=2024-07-04T01:57:00+00:00 2024-07-04T01:56:05.024221431Z [2024-07-04T01:56:05.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status success for try_number 1 2024-07-04T01:56:05.033243448Z [2024-07-04T01:56:05.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:55:00+00:00, map_index=-1, run_start_date=2024-07-04 01:56:02.921290+00:00, run_end_date=2024-07-04 01:56:04.742815+00:00, run_duration=1.821525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:56:01.045990+00:00, queued_by_job_id=2, pid=2700 2024-07-04T01:56:21.280842370Z [2024-07-04T01:56:21.280+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T01:57:00.292012350Z [2024-07-04T01:57:00.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:57:00+00:00, run_after=2024-07-04T01:58:00+00:00 2024-07-04T01:57:00.314333272Z [2024-07-04T01:57:00.313+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:57:00.413645696Z [2024-07-04T01:57:00.409+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:57:00.413676550Z 2024-07-04T01:57:00.413680311Z 2024-07-04T01:57:00.413731001Z [2024-07-04T01:57:00.410+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:57:00.413734627Z [2024-07-04T01:57:00.410+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:57:00.414254879Z [2024-07-04T01:57:00.413+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:57:00.414280352Z 2024-07-04T01:57:00.414283874Z 2024-07-04T01:57:00.418394875Z [2024-07-04T01:57:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:57:00.418491850Z [2024-07-04T01:57:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:57:00.418688034Z [2024-07-04T01:57:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:57:00.418731898Z [2024-07-04T01:57:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:57:00.612545703Z [2024-07-04T01:57:00.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:56:00+00:00 exited with status queued for try_number 1 2024-07-04T01:57:00.614575527Z [2024-07-04T01:57:00.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:56:00+00:00 exited with status queued for try_number 1 2024-07-04T01:57:00.621550276Z [2024-07-04T01:57:00.621+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91f581ad-ac11-412f-b867-54186dae6635 2024-07-04T01:57:00.621763429Z [2024-07-04T01:57:00.621+0000] {scheduler_job.py:635} INFO - Setting external_id for to 372a1189-29e5-4c36-9eea-868f8d3f8f1f 2024-07-04T01:57:04.397274834Z [2024-07-04T01:57:04.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:57:04.397599314Z [2024-07-04T01:57:04.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:56:00+00:00, run_id=scheduled__2024-07-04T01:56:00+00:00, run_start_date=2024-07-04 01:57:00.333082+00:00, run_end_date=2024-07-04 01:57:04.397197+00:00, run_duration=4.064115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:56:00+00:00, data_interval_end=2024-07-04 01:57:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:57:04.412589152Z [2024-07-04T01:57:04.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:57:00+00:00, run_after=2024-07-04T01:58:00+00:00 2024-07-04T01:57:04.473223484Z [2024-07-04T01:57:04.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:56:00+00:00 exited with status success for try_number 1 2024-07-04T01:57:04.480406845Z [2024-07-04T01:57:04.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:56:00+00:00, map_index=-1, run_start_date=2024-07-04 01:57:02.549133+00:00, run_end_date=2024-07-04 01:57:04.059720+00:00, run_duration=1.510587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:57:00.414946+00:00, queued_by_job_id=2, pid=2753 2024-07-04T01:57:05.532604200Z [2024-07-04T01:57:05.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:57:05.533245028Z [2024-07-04T01:57:05.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:56:00+00:00, run_id=scheduled__2024-07-04T01:56:00+00:00, run_start_date=2024-07-04 01:57:00.340174+00:00, run_end_date=2024-07-04 01:57:05.532717+00:00, run_duration=5.192543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:56:00+00:00, data_interval_end=2024-07-04 01:57:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:57:05.546906859Z [2024-07-04T01:57:05.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:57:00+00:00, run_after=2024-07-04T01:58:00+00:00 2024-07-04T01:57:05.584902297Z [2024-07-04T01:57:05.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:56:00+00:00 exited with status success for try_number 1 2024-07-04T01:57:05.594485410Z [2024-07-04T01:57:05.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:56:00+00:00, map_index=-1, run_start_date=2024-07-04 01:57:02.442749+00:00, run_end_date=2024-07-04 01:57:04.393149+00:00, run_duration=1.9504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:57:00.414946+00:00, queued_by_job_id=2, pid=2752 2024-07-04T01:58:00.573217816Z [2024-07-04T01:58:00.571+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:58:00.595779041Z [2024-07-04T01:58:00.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:58:00+00:00, run_after=2024-07-04T01:59:00+00:00 2024-07-04T01:58:00.603202567Z [2024-07-04T01:58:00.602+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:58:00.664340537Z [2024-07-04T01:58:00.663+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T01:58:00.664378085Z 2024-07-04T01:58:00.664382692Z 2024-07-04T01:58:00.664386068Z 2024-07-04T01:58:00.664600599Z [2024-07-04T01:58:00.664+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T01:58:00.664815918Z [2024-07-04T01:58:00.664+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:58:00.665008891Z [2024-07-04T01:58:00.664+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:58:00.665699347Z [2024-07-04T01:58:00.665+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:58:00.665711509Z 2024-07-04T01:58:00.665715384Z 2024-07-04T01:58:00.665719132Z 2024-07-04T01:58:00.669203086Z [2024-07-04T01:58:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:58:00.669500008Z [2024-07-04T01:58:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:58:00.669843286Z [2024-07-04T01:58:00.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:58:00.670078364Z [2024-07-04T01:58:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:58:00.670424742Z [2024-07-04T01:58:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:58:00.670616079Z [2024-07-04T01:58:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:58:01.048030472Z [2024-07-04T01:58:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:56:00+00:00 exited with status queued for try_number 1 2024-07-04T01:58:01.048177915Z [2024-07-04T01:58:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:57:00+00:00 exited with status queued for try_number 1 2024-07-04T01:58:01.048353012Z [2024-07-04T01:58:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:57:00+00:00 exited with status queued for try_number 1 2024-07-04T01:58:01.063798778Z [2024-07-04T01:58:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ffffdab-7385-4a18-93a5-9f35e7c80afa 2024-07-04T01:58:01.063902180Z [2024-07-04T01:58:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f34257f-1e4e-4b92-a52e-1e0c5ea90451 2024-07-04T01:58:01.064007183Z [2024-07-04T01:58:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bf37e79-8bd1-41cd-85fd-5c7fe1ba878e 2024-07-04T01:58:03.179687571Z [2024-07-04T01:58:03.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:58:03.180031939Z [2024-07-04T01:58:03.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:56:00+00:00, run_id=scheduled__2024-07-04T01:56:00+00:00, run_start_date=2024-07-04 01:58:00.613785+00:00, run_end_date=2024-07-04 01:58:03.179577+00:00, run_duration=2.565792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:56:00+00:00, data_interval_end=2024-07-04 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T01:58:03.199184428Z [2024-07-04T01:58:03.198+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T01:58:00+00:00, run_after=2024-07-04T02:00:00+00:00 2024-07-04T01:58:03.308040056Z [2024-07-04T01:58:03.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:56:00+00:00 exited with status success for try_number 1 2024-07-04T01:58:03.320106394Z [2024-07-04T01:58:03.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:56:00+00:00, map_index=-1, run_start_date=2024-07-04 01:58:01.736199+00:00, run_end_date=2024-07-04 01:58:02.200028+00:00, run_duration=0.463829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:58:00.666520+00:00, queued_by_job_id=2, pid=2789 2024-07-04T01:58:04.367650001Z [2024-07-04T01:58:04.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:58:04.367995594Z [2024-07-04T01:58:04.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:57:00+00:00, run_id=scheduled__2024-07-04T01:57:00+00:00, run_start_date=2024-07-04 01:58:00.616211+00:00, run_end_date=2024-07-04 01:58:04.367501+00:00, run_duration=3.75129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:57:00+00:00, data_interval_end=2024-07-04 01:58:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:58:04.377106577Z [2024-07-04T01:58:04.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:58:00+00:00, run_after=2024-07-04T01:59:00+00:00 2024-07-04T01:58:04.425476338Z [2024-07-04T01:58:04.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:57:00+00:00 exited with status success for try_number 1 2024-07-04T01:58:04.433644222Z [2024-07-04T01:58:04.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:57:00+00:00, map_index=-1, run_start_date=2024-07-04 01:58:02.830135+00:00, run_end_date=2024-07-04 01:58:04.171622+00:00, run_duration=1.341487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:58:00.666520+00:00, queued_by_job_id=2, pid=2819 2024-07-04T01:58:06.574515750Z [2024-07-04T01:58:06.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:58:06.574958494Z [2024-07-04T01:58:06.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:57:00+00:00, run_id=scheduled__2024-07-04T01:57:00+00:00, run_start_date=2024-07-04 01:58:00.615180+00:00, run_end_date=2024-07-04 01:58:06.574371+00:00, run_duration=5.959191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:57:00+00:00, data_interval_end=2024-07-04 01:58:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:58:06.587366124Z [2024-07-04T01:58:06.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:58:00+00:00, run_after=2024-07-04T01:59:00+00:00 2024-07-04T01:58:06.630299677Z [2024-07-04T01:58:06.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:57:00+00:00 exited with status success for try_number 1 2024-07-04T01:58:06.648231988Z [2024-07-04T01:58:06.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:57:00+00:00, map_index=-1, run_start_date=2024-07-04 01:58:02.961917+00:00, run_end_date=2024-07-04 01:58:05.383572+00:00, run_duration=2.421655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:58:00.666520+00:00, queued_by_job_id=2, pid=2820 2024-07-04T01:59:00.806172488Z [2024-07-04T01:59:00.805+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:59:00+00:00, run_after=2024-07-04T02:00:00+00:00 2024-07-04T01:59:00.814283824Z [2024-07-04T01:59:00.813+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T01:59:00.878094414Z [2024-07-04T01:59:00.877+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T01:59:00.878121132Z 2024-07-04T01:59:00.878124848Z 2024-07-04T01:59:00.878134609Z [2024-07-04T01:59:00.878+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:59:00.878236138Z [2024-07-04T01:59:00.878+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T01:59:00.878924103Z [2024-07-04T01:59:00.878+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T01:59:00.878937599Z 2024-07-04T01:59:00.878941332Z 2024-07-04T01:59:00.882549400Z [2024-07-04T01:59:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:59:00.882650629Z [2024-07-04T01:59:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:59:00.882821887Z [2024-07-04T01:59:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T01:59:00.882920416Z [2024-07-04T01:59:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:59:01.172863051Z [2024-07-04T01:59:01.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:58:00+00:00 exited with status queued for try_number 1 2024-07-04T01:59:01.174599322Z [2024-07-04T01:59:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:58:00+00:00 exited with status queued for try_number 1 2024-07-04T01:59:01.185389938Z [2024-07-04T01:59:01.184+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62f99aaf-edfc-4c68-85c5-b76ee788019e 2024-07-04T01:59:01.185554559Z [2024-07-04T01:59:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a299956-fc95-49d9-a88c-68a2dcbb9342 2024-07-04T01:59:05.209273726Z [2024-07-04T01:59:05.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:59:05.209585670Z [2024-07-04T01:59:05.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:58:00+00:00, run_id=scheduled__2024-07-04T01:58:00+00:00, run_start_date=2024-07-04 01:59:00.832832+00:00, run_end_date=2024-07-04 01:59:05.209079+00:00, run_duration=4.376247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:58:00+00:00, data_interval_end=2024-07-04 01:59:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T01:59:05.218216087Z [2024-07-04T01:59:05.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:59:00+00:00, run_after=2024-07-04T02:00:00+00:00 2024-07-04T01:59:05.254772651Z [2024-07-04T01:59:05.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:58:00+00:00 exited with status success for try_number 1 2024-07-04T01:59:05.260193418Z [2024-07-04T01:59:05.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:58:00+00:00, map_index=-1, run_start_date=2024-07-04 01:59:02.836450+00:00, run_end_date=2024-07-04 01:59:04.604071+00:00, run_duration=1.767621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:59:00.879562+00:00, queued_by_job_id=2, pid=2873 2024-07-04T01:59:06.319673764Z [2024-07-04T01:59:06.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T01:59:06.321229356Z [2024-07-04T01:59:06.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:58:00+00:00, run_id=scheduled__2024-07-04T01:58:00+00:00, run_start_date=2024-07-04 01:59:00.835144+00:00, run_end_date=2024-07-04 01:59:06.319535+00:00, run_duration=5.484391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:58:00+00:00, data_interval_end=2024-07-04 01:59:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T01:59:06.336496672Z [2024-07-04T01:59:06.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T01:59:00+00:00, run_after=2024-07-04T02:00:00+00:00 2024-07-04T01:59:06.402097571Z [2024-07-04T01:59:06.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:58:00+00:00 exited with status success for try_number 1 2024-07-04T01:59:06.411590499Z [2024-07-04T01:59:06.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:58:00+00:00, map_index=-1, run_start_date=2024-07-04 01:59:02.871980+00:00, run_end_date=2024-07-04 01:59:05.373850+00:00, run_duration=2.50187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 01:59:00.879562+00:00, queued_by_job_id=2, pid=2874 2024-07-04T02:00:01.073391643Z [2024-07-04T02:00:01.072+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:00:01.093442829Z [2024-07-04T02:00:01.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:00:00+00:00, run_after=2024-07-04T02:01:00+00:00 2024-07-04T02:00:01.121556899Z [2024-07-04T02:00:01.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:00:00+00:00, run_after=2024-07-04T02:05:00+00:00 2024-07-04T02:00:01.132365507Z [2024-07-04T02:00:01.132+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:00:01.261491726Z [2024-07-04T02:00:01.261+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T02:00:01.261520331Z 2024-07-04T02:00:01.261524088Z 2024-07-04T02:00:01.261527857Z 2024-07-04T02:00:01.261531492Z 2024-07-04T02:00:01.261642575Z [2024-07-04T02:00:01.261+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:00:01.261783652Z [2024-07-04T02:00:01.261+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:00:01.261901583Z [2024-07-04T02:00:01.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:00:01.262015563Z [2024-07-04T02:00:01.261+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:00:01.262689515Z [2024-07-04T02:00:01.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:00:01.262697840Z 2024-07-04T02:00:01.262702040Z 2024-07-04T02:00:01.262705373Z 2024-07-04T02:00:01.262708667Z 2024-07-04T02:00:01.266292634Z [2024-07-04T02:00:01.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:00:01.266459563Z [2024-07-04T02:00:01.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:00:01.266717090Z [2024-07-04T02:00:01.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:00:01.266851260Z [2024-07-04T02:00:01.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:00:01.267490829Z [2024-07-04T02:00:01.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:00:01.267622078Z [2024-07-04T02:00:01.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:00:01.267851652Z [2024-07-04T02:00:01.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:00:01.267975745Z [2024-07-04T02:00:01.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:00:01.687805679Z [2024-07-04T02:00:01.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status queued for try_number 1 2024-07-04T02:00:01.687995010Z [2024-07-04T02:00:01.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:58:00+00:00 exited with status queued for try_number 1 2024-07-04T02:00:01.688223085Z [2024-07-04T02:00:01.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:59:00+00:00 exited with status queued for try_number 1 2024-07-04T02:00:01.689280829Z [2024-07-04T02:00:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:59:00+00:00 exited with status queued for try_number 1 2024-07-04T02:00:01.704298856Z [2024-07-04T02:00:01.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1893745-91de-4928-ad45-9bd07b4d1571 2024-07-04T02:00:01.704653592Z [2024-07-04T02:00:01.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 179cdfa1-3a54-4232-bdc1-28850453909a 2024-07-04T02:00:01.704936141Z [2024-07-04T02:00:01.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to ceb2917f-3066-4f64-b373-8d217ddcd034 2024-07-04T02:00:01.705288488Z [2024-07-04T02:00:01.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to aefb3bf6-130e-46df-a9bd-c88bfa01fff9 2024-07-04T02:00:02.974907176Z [2024-07-04T02:00:02.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:00:02.975905127Z [2024-07-04T02:00:02.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 01:58:00+00:00, run_id=scheduled__2024-07-04T01:58:00+00:00, run_start_date=2024-07-04 02:00:01.162640+00:00, run_end_date=2024-07-04 02:00:02.975482+00:00, run_duration=1.812842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:58:00+00:00, data_interval_end=2024-07-04 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:00:02.993686548Z [2024-07-04T02:00:02.993+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:00:00+00:00, run_after=2024-07-04T02:02:00+00:00 2024-07-04T02:00:03.997445669Z [2024-07-04T02:00:03.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T01:58:00+00:00 exited with status success for try_number 1 2024-07-04T02:00:04.020296352Z [2024-07-04T02:00:04.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T01:58:00+00:00, map_index=-1, run_start_date=2024-07-04 02:00:02.328795+00:00, run_end_date=2024-07-04 02:00:02.838778+00:00, run_duration=0.509983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:00:01.263606+00:00, queued_by_job_id=2, pid=2909 2024-07-04T02:00:05.176416632Z [2024-07-04T02:00:05.175+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:00:05.176467977Z 2024-07-04T02:00:05.176590663Z [2024-07-04T02:00:05.176+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:00:05.177586203Z [2024-07-04T02:00:05.177+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:00:05.177600768Z 2024-07-04T02:00:05.181678266Z [2024-07-04T02:00:05.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:00:05.181761474Z [2024-07-04T02:00:05.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:00:05.247008777Z [2024-07-04T02:00:05.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status queued for try_number 1 2024-07-04T02:00:05.249338963Z [2024-07-04T02:00:05.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status success for try_number 1 2024-07-04T02:00:05.255068354Z [2024-07-04T02:00:05.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10b726c7-9d3b-43ca-b6c5-571f8aaa8c3b 2024-07-04T02:00:05.255323807Z [2024-07-04T02:00:05.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T01:55:00+00:00, map_index=-1, run_start_date=2024-07-04 02:00:03.485396+00:00, run_end_date=2024-07-04 02:00:03.993890+00:00, run_duration=0.508494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:00:01.263606+00:00, queued_by_job_id=2, pid=2943 2024-07-04T02:00:06.418340542Z [2024-07-04T02:00:06.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:00:06.418570184Z [2024-07-04T02:00:06.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:59:00+00:00, run_id=scheduled__2024-07-04T01:59:00+00:00, run_start_date=2024-07-04 02:00:01.166696+00:00, run_end_date=2024-07-04 02:00:06.418253+00:00, run_duration=5.251557, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:59:00+00:00, data_interval_end=2024-07-04 02:00:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:00:06.433785436Z [2024-07-04T02:00:06.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:00:00+00:00, run_after=2024-07-04T02:01:00+00:00 2024-07-04T02:00:06.443653433Z [2024-07-04T02:00:06.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:00:06.444225927Z [2024-07-04T02:00:06.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:59:00+00:00, run_id=scheduled__2024-07-04T01:59:00+00:00, run_start_date=2024-07-04 02:00:01.165197+00:00, run_end_date=2024-07-04 02:00:06.443844+00:00, run_duration=5.278647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:59:00+00:00, data_interval_end=2024-07-04 02:00:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:00:06.457469492Z [2024-07-04T02:00:06.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:00:00+00:00, run_after=2024-07-04T02:01:00+00:00 2024-07-04T02:00:06.510258132Z [2024-07-04T02:00:06.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:59:00+00:00 exited with status success for try_number 1 2024-07-04T02:00:06.512595253Z [2024-07-04T02:00:06.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T01:59:00+00:00 exited with status success for try_number 1 2024-07-04T02:00:06.521180485Z [2024-07-04T02:00:06.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:59:00+00:00, map_index=-1, run_start_date=2024-07-04 02:00:03.407346+00:00, run_end_date=2024-07-04 02:00:05.395864+00:00, run_duration=1.988518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:00:01.263606+00:00, queued_by_job_id=2, pid=2938 2024-07-04T02:00:06.521610716Z [2024-07-04T02:00:06.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T01:59:00+00:00, map_index=-1, run_start_date=2024-07-04 02:00:03.786188+00:00, run_end_date=2024-07-04 02:00:05.352624+00:00, run_duration=1.566436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:00:01.263606+00:00, queued_by_job_id=2, pid=2958 2024-07-04T02:00:07.593272074Z [2024-07-04T02:00:07.592+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:00:07.593308156Z 2024-07-04T02:00:07.593314204Z [2024-07-04T02:00:07.592+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:00:07.594054052Z [2024-07-04T02:00:07.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:00:07.594078291Z 2024-07-04T02:00:07.596463093Z [2024-07-04T02:00:07.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:00:07.596719335Z [2024-07-04T02:00:07.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:00:07.696651845Z [2024-07-04T02:00:07.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status queued for try_number 1 2024-07-04T02:00:07.696934276Z [2024-07-04T02:00:07.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status success for try_number 1 2024-07-04T02:00:07.703105951Z [2024-07-04T02:00:07.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 717405e1-2de2-4690-b77e-4707aff63e84 2024-07-04T02:00:07.703392552Z [2024-07-04T02:00:07.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T01:55:00+00:00, map_index=-1, run_start_date=2024-07-04 02:00:06.905327+00:00, run_end_date=2024-07-04 02:00:07.313019+00:00, run_duration=0.407692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:00:05.178165+00:00, queued_by_job_id=2, pid=2988 2024-07-04T02:00:10.268145531Z [2024-07-04T02:00:10.267+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:00:10.268232926Z 2024-07-04T02:00:10.268246936Z [2024-07-04T02:00:10.267+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:00:10.268798015Z [2024-07-04T02:00:10.268+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:00:10.268814847Z 2024-07-04T02:00:10.272279568Z [2024-07-04T02:00:10.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:00:10.272439087Z [2024-07-04T02:00:10.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:00:10.346992576Z [2024-07-04T02:00:10.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status queued for try_number 1 2024-07-04T02:00:10.347038182Z [2024-07-04T02:00:10.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status success for try_number 1 2024-07-04T02:00:10.364205377Z [2024-07-04T02:00:10.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22fc51e9-3e95-4474-a68b-75ae10a5f372 2024-07-04T02:00:10.365155190Z [2024-07-04T02:00:10.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T01:55:00+00:00, map_index=0, run_start_date=2024-07-04 02:00:09.247460+00:00, run_end_date=2024-07-04 02:00:09.634491+00:00, run_duration=0.387031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:00:07.594388+00:00, queued_by_job_id=2, pid=3000 2024-07-04T02:00:13.714054258Z [2024-07-04T02:00:13.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:00:13.714462919Z [2024-07-04T02:00:13.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 01:55:00+00:00, run_id=scheduled__2024-07-04T01:55:00+00:00, run_start_date=2024-07-04 02:00:01.159439+00:00, run_end_date=2024-07-04 02:00:13.713818+00:00, run_duration=12.554379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 01:55:00+00:00, data_interval_end=2024-07-04 02:00:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:00:13.721347148Z [2024-07-04T02:00:13.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:00:00+00:00, run_after=2024-07-04T02:05:00+00:00 2024-07-04T02:00:13.761194483Z [2024-07-04T02:00:13.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T01:55:00+00:00 exited with status success for try_number 1 2024-07-04T02:00:13.770615061Z [2024-07-04T02:00:13.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T01:55:00+00:00, map_index=-1, run_start_date=2024-07-04 02:00:12.117959+00:00, run_end_date=2024-07-04 02:00:12.513099+00:00, run_duration=0.39514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:00:10.269199+00:00, queued_by_job_id=2, pid=3012 2024-07-04T02:01:00.253732105Z [2024-07-04T02:01:00.253+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:01:00.268320509Z [2024-07-04T02:01:00.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:01:00+00:00, run_after=2024-07-04T02:02:00+00:00 2024-07-04T02:01:00.358248805Z [2024-07-04T02:01:00.357+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:01:00.358303290Z 2024-07-04T02:01:00.358318242Z 2024-07-04T02:01:00.358512308Z [2024-07-04T02:01:00.358+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:01:00.358629739Z [2024-07-04T02:01:00.358+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:01:00.359213718Z [2024-07-04T02:01:00.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:01:00.359227788Z 2024-07-04T02:01:00.359231712Z 2024-07-04T02:01:00.362195545Z [2024-07-04T02:01:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:01:00.362229020Z [2024-07-04T02:01:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:01:00.362529781Z [2024-07-04T02:01:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:01:00.362851246Z [2024-07-04T02:01:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:01:00.675895734Z [2024-07-04T02:01:00.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status queued for try_number 1 2024-07-04T02:01:00.675929853Z [2024-07-04T02:01:00.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status queued for try_number 1 2024-07-04T02:01:00.689530438Z [2024-07-04T02:01:00.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d94543b-feb9-4f95-a2fe-66a1a948b9c8 2024-07-04T02:01:00.689576488Z [2024-07-04T02:01:00.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fe9038a-e863-4048-9e06-facfa5dc04f6 2024-07-04T02:01:04.139110519Z [2024-07-04T02:01:04.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:01:04.139785512Z [2024-07-04T02:01:04.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:00:00+00:00, run_id=scheduled__2024-07-04T02:00:00+00:00, run_start_date=2024-07-04 02:01:00.281127+00:00, run_end_date=2024-07-04 02:01:04.139021+00:00, run_duration=3.857894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:00:00+00:00, data_interval_end=2024-07-04 02:01:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:01:04.156644167Z [2024-07-04T02:01:04.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:01:00+00:00, run_after=2024-07-04T02:02:00+00:00 2024-07-04T02:01:04.192899563Z [2024-07-04T02:01:04.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status success for try_number 1 2024-07-04T02:01:04.197871447Z [2024-07-04T02:01:04.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:00:00+00:00, map_index=-1, run_start_date=2024-07-04 02:01:02.312962+00:00, run_end_date=2024-07-04 02:01:03.712538+00:00, run_duration=1.399576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:01:00.359796+00:00, queued_by_job_id=2, pid=3048 2024-07-04T02:01:05.095613848Z [2024-07-04T02:01:05.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:01:05.096108547Z [2024-07-04T02:01:05.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:00:00+00:00, run_id=scheduled__2024-07-04T02:00:00+00:00, run_start_date=2024-07-04 02:01:00.279605+00:00, run_end_date=2024-07-04 02:01:05.095634+00:00, run_duration=4.816029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:00:00+00:00, data_interval_end=2024-07-04 02:01:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:01:05.109512342Z [2024-07-04T02:01:05.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:01:00+00:00, run_after=2024-07-04T02:02:00+00:00 2024-07-04T02:01:05.155962391Z [2024-07-04T02:01:05.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status success for try_number 1 2024-07-04T02:01:05.164540243Z [2024-07-04T02:01:05.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:00:00+00:00, map_index=-1, run_start_date=2024-07-04 02:01:02.426559+00:00, run_end_date=2024-07-04 02:01:04.571800+00:00, run_duration=2.145241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:01:00.359796+00:00, queued_by_job_id=2, pid=3049 2024-07-04T02:01:21.358995008Z [2024-07-04T02:01:21.358+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:02:00.646981460Z [2024-07-04T02:02:00.646+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:02:00.662332767Z [2024-07-04T02:02:00.661+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:02:00+00:00, run_after=2024-07-04T02:03:00+00:00 2024-07-04T02:02:00.671352187Z [2024-07-04T02:02:00.671+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:02:00.768293834Z [2024-07-04T02:02:00.767+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:02:00.768348189Z 2024-07-04T02:02:00.768361229Z 2024-07-04T02:02:00.768368294Z 2024-07-04T02:02:00.768395299Z [2024-07-04T02:02:00.768+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:02:00.768956496Z [2024-07-04T02:02:00.768+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:02:00.769214056Z [2024-07-04T02:02:00.768+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:02:00.770105728Z [2024-07-04T02:02:00.769+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:02:00.770121160Z 2024-07-04T02:02:00.770125763Z 2024-07-04T02:02:00.770129760Z 2024-07-04T02:02:00.775746838Z [2024-07-04T02:02:00.775+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:02:00.775939997Z [2024-07-04T02:02:00.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:02:00.776247295Z [2024-07-04T02:02:00.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:02:00.776342120Z [2024-07-04T02:02:00.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:02:00.776622254Z [2024-07-04T02:02:00.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:02:00.776732974Z [2024-07-04T02:02:00.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:02:01.155811617Z [2024-07-04T02:02:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status queued for try_number 1 2024-07-04T02:02:01.159277184Z [2024-07-04T02:02:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:01:00+00:00 exited with status queued for try_number 1 2024-07-04T02:02:01.159536214Z [2024-07-04T02:02:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:01:00+00:00 exited with status queued for try_number 1 2024-07-04T02:02:01.179662175Z [2024-07-04T02:02:01.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c813dea-211a-481f-a215-dbb281a684b3 2024-07-04T02:02:01.180002502Z [2024-07-04T02:02:01.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33e86396-0637-41d3-8371-4ff9fbc71e43 2024-07-04T02:02:01.180252184Z [2024-07-04T02:02:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to d074a1d2-ea40-4173-946f-c85f3badfb47 2024-07-04T02:02:02.409540765Z [2024-07-04T02:02:02.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:02:02.409946414Z [2024-07-04T02:02:02.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:00:00+00:00, run_id=scheduled__2024-07-04T02:00:00+00:00, run_start_date=2024-07-04 02:02:00.685865+00:00, run_end_date=2024-07-04 02:02:02.409450+00:00, run_duration=1.723585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:00:00+00:00, data_interval_end=2024-07-04 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:02:02.418470329Z [2024-07-04T02:02:02.418+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:02:00+00:00, run_after=2024-07-04T02:04:00+00:00 2024-07-04T02:02:02.479883957Z [2024-07-04T02:02:02.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status success for try_number 1 2024-07-04T02:02:02.485546712Z [2024-07-04T02:02:02.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:00:00+00:00, map_index=-1, run_start_date=2024-07-04 02:02:01.641932+00:00, run_end_date=2024-07-04 02:02:02.046533+00:00, run_duration=0.404601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:02:00.772269+00:00, queued_by_job_id=2, pid=3084 2024-07-04T02:02:04.656918055Z [2024-07-04T02:02:04.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:02:04.657246929Z [2024-07-04T02:02:04.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:01:00+00:00, run_id=scheduled__2024-07-04T02:01:00+00:00, run_start_date=2024-07-04 02:02:00.692274+00:00, run_end_date=2024-07-04 02:02:04.656860+00:00, run_duration=3.964586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:01:00+00:00, data_interval_end=2024-07-04 02:02:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:02:04.668929824Z [2024-07-04T02:02:04.668+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:02:00+00:00, run_after=2024-07-04T02:03:00+00:00 2024-07-04T02:02:04.677094963Z [2024-07-04T02:02:04.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:02:04.677342645Z [2024-07-04T02:02:04.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:01:00+00:00, run_id=scheduled__2024-07-04T02:01:00+00:00, run_start_date=2024-07-04 02:02:00.695818+00:00, run_end_date=2024-07-04 02:02:04.677064+00:00, run_duration=3.981246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:01:00+00:00, data_interval_end=2024-07-04 02:02:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:02:04.686453878Z [2024-07-04T02:02:04.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:02:00+00:00, run_after=2024-07-04T02:03:00+00:00 2024-07-04T02:02:04.729218590Z [2024-07-04T02:02:04.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:01:00+00:00 exited with status success for try_number 1 2024-07-04T02:02:04.742637732Z [2024-07-04T02:02:04.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:01:00+00:00, map_index=-1, run_start_date=2024-07-04 02:02:02.580849+00:00, run_end_date=2024-07-04 02:02:03.866213+00:00, run_duration=1.285364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:02:00.772269+00:00, queued_by_job_id=2, pid=3114 2024-07-04T02:02:05.827049953Z [2024-07-04T02:02:05.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:01:00+00:00 exited with status success for try_number 1 2024-07-04T02:02:05.838832513Z [2024-07-04T02:02:05.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:01:00+00:00, map_index=-1, run_start_date=2024-07-04 02:02:02.717306+00:00, run_end_date=2024-07-04 02:02:04.598979+00:00, run_duration=1.881673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:02:00.772269+00:00, queued_by_job_id=2, pid=3115 2024-07-04T02:03:01.017916127Z [2024-07-04T02:03:01.017+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:03:00+00:00, run_after=2024-07-04T02:04:00+00:00 2024-07-04T02:03:01.025829281Z [2024-07-04T02:03:01.025+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:03:01.076671256Z [2024-07-04T02:03:01.076+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:03:01.076706972Z 2024-07-04T02:03:01.076710971Z 2024-07-04T02:03:01.076937567Z [2024-07-04T02:03:01.076+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:03:01.077196670Z [2024-07-04T02:03:01.076+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:03:01.077845008Z [2024-07-04T02:03:01.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:03:01.077857883Z 2024-07-04T02:03:01.077861405Z 2024-07-04T02:03:01.080896131Z [2024-07-04T02:03:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:03:01.081007963Z [2024-07-04T02:03:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:03:01.081380184Z [2024-07-04T02:03:01.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:03:01.081664568Z [2024-07-04T02:03:01.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:03:01.253744370Z [2024-07-04T02:03:01.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:02:00+00:00 exited with status queued for try_number 1 2024-07-04T02:03:01.253786610Z [2024-07-04T02:03:01.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:02:00+00:00 exited with status queued for try_number 1 2024-07-04T02:03:01.263735517Z [2024-07-04T02:03:01.263+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d85fbac-fcec-4ba1-95fd-5f21fc1727ad 2024-07-04T02:03:01.263976235Z [2024-07-04T02:03:01.263+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68e0af21-7d13-43a3-9cab-8a8d394b71e0 2024-07-04T02:03:05.448650003Z [2024-07-04T02:03:05.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:03:05.449459645Z [2024-07-04T02:03:05.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:02:00+00:00, run_id=scheduled__2024-07-04T02:02:00+00:00, run_start_date=2024-07-04 02:03:01.035033+00:00, run_end_date=2024-07-04 02:03:05.448638+00:00, run_duration=4.413605, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:02:00+00:00, data_interval_end=2024-07-04 02:03:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:03:05.464457141Z [2024-07-04T02:03:05.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:03:00+00:00, run_after=2024-07-04T02:04:00+00:00 2024-07-04T02:03:05.520274805Z [2024-07-04T02:03:05.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:02:00+00:00 exited with status success for try_number 1 2024-07-04T02:03:05.526734364Z [2024-07-04T02:03:05.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:02:00+00:00, map_index=-1, run_start_date=2024-07-04 02:03:02.930677+00:00, run_end_date=2024-07-04 02:03:04.538917+00:00, run_duration=1.60824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:03:01.078463+00:00, queued_by_job_id=2, pid=3170 2024-07-04T02:03:06.583140903Z [2024-07-04T02:03:06.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:03:06.583479365Z [2024-07-04T02:03:06.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:02:00+00:00, run_id=scheduled__2024-07-04T02:02:00+00:00, run_start_date=2024-07-04 02:03:01.036606+00:00, run_end_date=2024-07-04 02:03:06.582958+00:00, run_duration=5.546352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:02:00+00:00, data_interval_end=2024-07-04 02:03:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:03:06.596431837Z [2024-07-04T02:03:06.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:03:00+00:00, run_after=2024-07-04T02:04:00+00:00 2024-07-04T02:03:06.633251662Z [2024-07-04T02:03:06.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:02:00+00:00 exited with status success for try_number 1 2024-07-04T02:03:06.642960613Z [2024-07-04T02:03:06.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:02:00+00:00, map_index=-1, run_start_date=2024-07-04 02:03:02.930842+00:00, run_end_date=2024-07-04 02:03:05.423459+00:00, run_duration=2.492617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:03:01.078463+00:00, queued_by_job_id=2, pid=3171 2024-07-04T02:04:00.356412112Z [2024-07-04T02:04:00.355+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:04:00.372352834Z [2024-07-04T02:04:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:04:00+00:00, run_after=2024-07-04T02:05:00+00:00 2024-07-04T02:04:00.379208296Z [2024-07-04T02:04:00.378+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:04:00.448251161Z [2024-07-04T02:04:00.447+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:04:00.448282905Z 2024-07-04T02:04:00.448287936Z 2024-07-04T02:04:00.448291533Z 2024-07-04T02:04:00.448467706Z [2024-07-04T02:04:00.448+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:04:00.448670046Z [2024-07-04T02:04:00.448+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:04:00.448843737Z [2024-07-04T02:04:00.448+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:04:00.449844806Z [2024-07-04T02:04:00.449+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:04:00.449859064Z 2024-07-04T02:04:00.449863117Z 2024-07-04T02:04:00.449867110Z 2024-07-04T02:04:00.455564972Z [2024-07-04T02:04:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:04:00.455747659Z [2024-07-04T02:04:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:04:00.456082290Z [2024-07-04T02:04:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:04:00.456251083Z [2024-07-04T02:04:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:04:00.456543591Z [2024-07-04T02:04:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:04:00.456705390Z [2024-07-04T02:04:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:04:00.923862623Z [2024-07-04T02:04:00.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:02:00+00:00 exited with status queued for try_number 1 2024-07-04T02:04:00.924049748Z [2024-07-04T02:04:00.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:03:00+00:00 exited with status queued for try_number 1 2024-07-04T02:04:00.924167691Z [2024-07-04T02:04:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:03:00+00:00 exited with status queued for try_number 1 2024-07-04T02:04:00.934616694Z [2024-07-04T02:04:00.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bc7e4e0-3b36-494d-9198-4347f970b414 2024-07-04T02:04:00.934892509Z [2024-07-04T02:04:00.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7d5dfa8-5e59-4391-ab58-592539c7da56 2024-07-04T02:04:00.938179628Z [2024-07-04T02:04:00.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5966ba3c-f257-4167-a72d-9332b32223d8 2024-07-04T02:04:02.870773004Z [2024-07-04T02:04:02.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:04:02.871818611Z [2024-07-04T02:04:02.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:02:00+00:00, run_id=scheduled__2024-07-04T02:02:00+00:00, run_start_date=2024-07-04 02:04:00.390798+00:00, run_end_date=2024-07-04 02:04:02.870704+00:00, run_duration=2.479906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:02:00+00:00, data_interval_end=2024-07-04 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:04:02.879937387Z [2024-07-04T02:04:02.879+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:04:00+00:00, run_after=2024-07-04T02:06:00+00:00 2024-07-04T02:04:02.950179093Z [2024-07-04T02:04:02.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:02:00+00:00 exited with status success for try_number 1 2024-07-04T02:04:02.960389561Z [2024-07-04T02:04:02.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:02:00+00:00, map_index=-1, run_start_date=2024-07-04 02:04:01.402711+00:00, run_end_date=2024-07-04 02:04:01.783113+00:00, run_duration=0.380402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:04:00.451338+00:00, queued_by_job_id=2, pid=3206 2024-07-04T02:04:04.020199940Z [2024-07-04T02:04:04.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:04:04.020351885Z [2024-07-04T02:04:04.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:03:00+00:00, run_id=scheduled__2024-07-04T02:03:00+00:00, run_start_date=2024-07-04 02:04:00.393603+00:00, run_end_date=2024-07-04 02:04:04.020037+00:00, run_duration=3.626434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:03:00+00:00, data_interval_end=2024-07-04 02:04:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:04:04.030254858Z [2024-07-04T02:04:04.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:04:00+00:00, run_after=2024-07-04T02:05:00+00:00 2024-07-04T02:04:04.091107452Z [2024-07-04T02:04:04.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:03:00+00:00 exited with status success for try_number 1 2024-07-04T02:04:04.096720483Z [2024-07-04T02:04:04.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:03:00+00:00, map_index=-1, run_start_date=2024-07-04 02:04:02.620241+00:00, run_end_date=2024-07-04 02:04:03.915482+00:00, run_duration=1.295241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:04:00.451338+00:00, queued_by_job_id=2, pid=3236 2024-07-04T02:04:05.156007752Z [2024-07-04T02:04:05.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:04:05.156420574Z [2024-07-04T02:04:05.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:03:00+00:00, run_id=scheduled__2024-07-04T02:03:00+00:00, run_start_date=2024-07-04 02:04:00.392413+00:00, run_end_date=2024-07-04 02:04:05.155828+00:00, run_duration=4.763415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:03:00+00:00, data_interval_end=2024-07-04 02:04:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:04:05.174455776Z [2024-07-04T02:04:05.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:04:00+00:00, run_after=2024-07-04T02:05:00+00:00 2024-07-04T02:04:05.209219490Z [2024-07-04T02:04:05.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:03:00+00:00 exited with status success for try_number 1 2024-07-04T02:04:05.223220436Z [2024-07-04T02:04:05.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:03:00+00:00, map_index=-1, run_start_date=2024-07-04 02:04:02.608006+00:00, run_end_date=2024-07-04 02:04:04.169441+00:00, run_duration=1.561435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:04:00.451338+00:00, queued_by_job_id=2, pid=3235 2024-07-04T02:05:00.767830918Z [2024-07-04T02:05:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:05:00+00:00, run_after=2024-07-04T02:10:00+00:00 2024-07-04T02:05:00.785422943Z [2024-07-04T02:05:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:05:00+00:00, run_after=2024-07-04T02:06:00+00:00 2024-07-04T02:05:00.797812854Z [2024-07-04T02:05:00.797+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:05:00.900268803Z [2024-07-04T02:05:00.899+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:05:00.900295668Z 2024-07-04T02:05:00.900300245Z 2024-07-04T02:05:00.900303464Z 2024-07-04T02:05:00.900707553Z [2024-07-04T02:05:00.900+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:05:00.900940877Z [2024-07-04T02:05:00.900+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:05:00.901148257Z [2024-07-04T02:05:00.901+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:05:00.901916663Z [2024-07-04T02:05:00.901+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:05:00.901929008Z 2024-07-04T02:05:00.901933065Z 2024-07-04T02:05:00.901936880Z 2024-07-04T02:05:00.906397357Z [2024-07-04T02:05:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:05:00.906692484Z [2024-07-04T02:05:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:05:00.907084621Z [2024-07-04T02:05:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:05:00.907297364Z [2024-07-04T02:05:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:05:00.907606038Z [2024-07-04T02:05:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:05:00.907811090Z [2024-07-04T02:05:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:05:01.147931342Z [2024-07-04T02:05:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status queued for try_number 1 2024-07-04T02:05:01.147977741Z [2024-07-04T02:05:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:04:00+00:00 exited with status queued for try_number 1 2024-07-04T02:05:01.148126323Z [2024-07-04T02:05:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:04:00+00:00 exited with status queued for try_number 1 2024-07-04T02:05:01.157450278Z [2024-07-04T02:05:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bea72b9-0be5-45ff-9464-16237f806d99 2024-07-04T02:05:01.157528999Z [2024-07-04T02:05:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ef3f60b-65ab-48a0-8655-7fd689709832 2024-07-04T02:05:01.157678835Z [2024-07-04T02:05:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to e65aa19b-d622-4a59-83b9-3bb148ce1dda 2024-07-04T02:05:03.914392438Z [2024-07-04T02:05:03.913+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:05:03.914459943Z 2024-07-04T02:05:03.914947470Z [2024-07-04T02:05:03.914+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:05:03.916142668Z [2024-07-04T02:05:03.915+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:05:03.916199150Z 2024-07-04T02:05:03.921215868Z [2024-07-04T02:05:03.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:05:03.921545317Z [2024-07-04T02:05:03.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:05:03.982385637Z [2024-07-04T02:05:03.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status queued for try_number 1 2024-07-04T02:05:03.982550000Z [2024-07-04T02:05:03.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status success for try_number 1 2024-07-04T02:05:03.988111763Z [2024-07-04T02:05:03.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2275659d-1af3-4b56-82b3-de1f67ca859e 2024-07-04T02:05:03.988360640Z [2024-07-04T02:05:03.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:00:00+00:00, map_index=-1, run_start_date=2024-07-04 02:05:02.853735+00:00, run_end_date=2024-07-04 02:05:03.239475+00:00, run_duration=0.38574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:05:00.902837+00:00, queued_by_job_id=2, pid=3303 2024-07-04T02:05:05.183437933Z [2024-07-04T02:05:05.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:05:05.185878324Z [2024-07-04T02:05:05.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:04:00+00:00, run_id=scheduled__2024-07-04T02:04:00+00:00, run_start_date=2024-07-04 02:05:00.816183+00:00, run_end_date=2024-07-04 02:05:05.183371+00:00, run_duration=4.367188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:04:00+00:00, data_interval_end=2024-07-04 02:05:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:05:05.200404065Z [2024-07-04T02:05:05.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:05:00+00:00, run_after=2024-07-04T02:06:00+00:00 2024-07-04T02:05:05.209848921Z [2024-07-04T02:05:05.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:05:05.209987944Z [2024-07-04T02:05:05.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:04:00+00:00, run_id=scheduled__2024-07-04T02:04:00+00:00, run_start_date=2024-07-04 02:05:00.817583+00:00, run_end_date=2024-07-04 02:05:05.209759+00:00, run_duration=4.392176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:04:00+00:00, data_interval_end=2024-07-04 02:05:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:05:05.220811585Z [2024-07-04T02:05:05.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:05:00+00:00, run_after=2024-07-04T02:06:00+00:00 2024-07-04T02:05:05.283592086Z [2024-07-04T02:05:05.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:04:00+00:00 exited with status success for try_number 1 2024-07-04T02:05:05.283653509Z [2024-07-04T02:05:05.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:04:00+00:00 exited with status success for try_number 1 2024-07-04T02:05:05.300876653Z [2024-07-04T02:05:05.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:04:00+00:00, map_index=-1, run_start_date=2024-07-04 02:05:02.663992+00:00, run_end_date=2024-07-04 02:05:04.205187+00:00, run_duration=1.541195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:05:00.902837+00:00, queued_by_job_id=2, pid=3295 2024-07-04T02:05:05.301056125Z [2024-07-04T02:05:05.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:04:00+00:00, map_index=-1, run_start_date=2024-07-04 02:05:02.753315+00:00, run_end_date=2024-07-04 02:05:04.470365+00:00, run_duration=1.71705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:05:00.902837+00:00, queued_by_job_id=2, pid=3302 2024-07-04T02:05:06.403283682Z [2024-07-04T02:05:06.402+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:05:06.403332648Z 2024-07-04T02:05:06.403371911Z [2024-07-04T02:05:06.403+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:05:06.404738659Z [2024-07-04T02:05:06.404+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:05:06.404771471Z 2024-07-04T02:05:06.408616499Z [2024-07-04T02:05:06.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:05:06.408994204Z [2024-07-04T02:05:06.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:05:06.490077765Z [2024-07-04T02:05:06.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status queued for try_number 1 2024-07-04T02:05:06.490539874Z [2024-07-04T02:05:06.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status success for try_number 1 2024-07-04T02:05:06.502400688Z [2024-07-04T02:05:06.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fabbfa5-42b7-41fb-8916-11bdfe043d86 2024-07-04T02:05:06.502717247Z [2024-07-04T02:05:06.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:00:00+00:00, map_index=-1, run_start_date=2024-07-04 02:05:05.644321+00:00, run_end_date=2024-07-04 02:05:06.062111+00:00, run_duration=0.41779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:05:03.917122+00:00, queued_by_job_id=2, pid=3342 2024-07-04T02:05:08.773195015Z [2024-07-04T02:05:08.772+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:05:08.773235628Z 2024-07-04T02:05:08.774397259Z [2024-07-04T02:05:08.773+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:05:08.775951602Z [2024-07-04T02:05:08.775+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:05:08.775987928Z 2024-07-04T02:05:08.780712225Z [2024-07-04T02:05:08.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:05:08.781288569Z [2024-07-04T02:05:08.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:05:08.847926678Z [2024-07-04T02:05:08.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status queued for try_number 1 2024-07-04T02:05:08.850144042Z [2024-07-04T02:05:08.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status success for try_number 1 2024-07-04T02:05:08.861635971Z [2024-07-04T02:05:08.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b8868ad-7de2-4d28-8a20-dfb322daf789 2024-07-04T02:05:08.861885587Z [2024-07-04T02:05:08.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:00:00+00:00, map_index=0, run_start_date=2024-07-04 02:05:07.986553+00:00, run_end_date=2024-07-04 02:05:08.368410+00:00, run_duration=0.381857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:05:06.405449+00:00, queued_by_job_id=2, pid=3354 2024-07-04T02:05:11.930065558Z [2024-07-04T02:05:11.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:05:11.930458575Z [2024-07-04T02:05:11.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:00:00+00:00, run_id=scheduled__2024-07-04T02:00:00+00:00, run_start_date=2024-07-04 02:05:00.814577+00:00, run_end_date=2024-07-04 02:05:11.930073+00:00, run_duration=11.115496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:00:00+00:00, data_interval_end=2024-07-04 02:05:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:05:11.946655915Z [2024-07-04T02:05:11.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:05:00+00:00, run_after=2024-07-04T02:10:00+00:00 2024-07-04T02:05:11.988979432Z [2024-07-04T02:05:11.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:00:00+00:00 exited with status success for try_number 1 2024-07-04T02:05:11.995228575Z [2024-07-04T02:05:11.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:00:00+00:00, map_index=-1, run_start_date=2024-07-04 02:05:10.740118+00:00, run_end_date=2024-07-04 02:05:11.174527+00:00, run_duration=0.434409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:05:08.776889+00:00, queued_by_job_id=2, pid=3366 2024-07-04T02:06:00.090930019Z [2024-07-04T02:06:00.090+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:06:00.099206859Z [2024-07-04T02:06:00.098+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:06:00.111896736Z [2024-07-04T02:06:00.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:06:00+00:00, run_after=2024-07-04T02:07:00+00:00 2024-07-04T02:06:00.200681142Z [2024-07-04T02:06:00.200+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:06:00.200706590Z 2024-07-04T02:06:00.200726053Z 2024-07-04T02:06:00.200729737Z 2024-07-04T02:06:00.200922020Z [2024-07-04T02:06:00.200+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:06:00.201149236Z [2024-07-04T02:06:00.200+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:06:00.201361829Z [2024-07-04T02:06:00.201+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:06:00.202145075Z [2024-07-04T02:06:00.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:06:00.202170112Z 2024-07-04T02:06:00.202173801Z 2024-07-04T02:06:00.202177012Z 2024-07-04T02:06:00.206728187Z [2024-07-04T02:06:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:06:00.206921836Z [2024-07-04T02:06:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:06:00.207265722Z [2024-07-04T02:06:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:06:00.207449045Z [2024-07-04T02:06:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:06:00.207786227Z [2024-07-04T02:06:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:06:00.207960212Z [2024-07-04T02:06:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:06:00.584401314Z [2024-07-04T02:06:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:04:00+00:00 exited with status queued for try_number 1 2024-07-04T02:06:00.589046995Z [2024-07-04T02:06:00.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status queued for try_number 1 2024-07-04T02:06:00.589311924Z [2024-07-04T02:06:00.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status queued for try_number 1 2024-07-04T02:06:00.602202794Z [2024-07-04T02:06:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ce6449c-f9b9-4279-84c2-7f4eb09f02c3 2024-07-04T02:06:00.602562493Z [2024-07-04T02:06:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31dea2a8-55fd-4c34-ba99-7b015e7f3323 2024-07-04T02:06:00.602840355Z [2024-07-04T02:06:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to bca6b560-2d0f-4891-8041-e5137bb74679 2024-07-04T02:06:01.755104838Z [2024-07-04T02:06:01.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:06:01.755312260Z [2024-07-04T02:06:01.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:04:00+00:00, run_id=scheduled__2024-07-04T02:04:00+00:00, run_start_date=2024-07-04 02:06:00.127766+00:00, run_end_date=2024-07-04 02:06:01.755024+00:00, run_duration=1.627258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:04:00+00:00, data_interval_end=2024-07-04 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:06:01.763464313Z [2024-07-04T02:06:01.763+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:06:00+00:00, run_after=2024-07-04T02:08:00+00:00 2024-07-04T02:06:01.809978479Z [2024-07-04T02:06:01.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:04:00+00:00 exited with status success for try_number 1 2024-07-04T02:06:01.819956470Z [2024-07-04T02:06:01.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:04:00+00:00, map_index=-1, run_start_date=2024-07-04 02:06:01.211261+00:00, run_end_date=2024-07-04 02:06:01.592456+00:00, run_duration=0.381195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:06:00.203224+00:00, queued_by_job_id=2, pid=3383 2024-07-04T02:06:04.640599094Z [2024-07-04T02:06:04.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:06:04.641006635Z [2024-07-04T02:06:04.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:05:00+00:00, run_id=scheduled__2024-07-04T02:05:00+00:00, run_start_date=2024-07-04 02:06:00.129384+00:00, run_end_date=2024-07-04 02:06:04.640534+00:00, run_duration=4.51115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:05:00+00:00, data_interval_end=2024-07-04 02:06:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:06:04.657500916Z [2024-07-04T02:06:04.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:06:00+00:00, run_after=2024-07-04T02:07:00+00:00 2024-07-04T02:06:04.666717768Z [2024-07-04T02:06:04.666+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:06:04.667147995Z [2024-07-04T02:06:04.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:05:00+00:00, run_id=scheduled__2024-07-04T02:05:00+00:00, run_start_date=2024-07-04 02:06:00.130635+00:00, run_end_date=2024-07-04 02:06:04.666615+00:00, run_duration=4.53598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:05:00+00:00, data_interval_end=2024-07-04 02:06:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:06:04.678244372Z [2024-07-04T02:06:04.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:06:00+00:00, run_after=2024-07-04T02:07:00+00:00 2024-07-04T02:06:04.727740647Z [2024-07-04T02:06:04.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status success for try_number 1 2024-07-04T02:06:04.727795513Z [2024-07-04T02:06:04.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status success for try_number 1 2024-07-04T02:06:04.742139960Z [2024-07-04T02:06:04.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:05:00+00:00, map_index=-1, run_start_date=2024-07-04 02:06:02.432353+00:00, run_end_date=2024-07-04 02:06:04.168337+00:00, run_duration=1.735984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:06:00.203224+00:00, queued_by_job_id=2, pid=3413 2024-07-04T02:06:04.742169120Z [2024-07-04T02:06:04.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:05:00+00:00, map_index=-1, run_start_date=2024-07-04 02:06:02.600813+00:00, run_end_date=2024-07-04 02:06:03.911017+00:00, run_duration=1.310204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:06:00.203224+00:00, queued_by_job_id=2, pid=3414 2024-07-04T02:06:21.443803789Z [2024-07-04T02:06:21.443+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:07:00.685328746Z [2024-07-04T02:07:00.684+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:07:00.698082942Z [2024-07-04T02:07:00.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:07:00+00:00, run_after=2024-07-04T02:08:00+00:00 2024-07-04T02:07:00.752492127Z [2024-07-04T02:07:00.752+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:07:00.752537137Z 2024-07-04T02:07:00.752546360Z 2024-07-04T02:07:00.752555243Z [2024-07-04T02:07:00.752+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:07:00.752801760Z [2024-07-04T02:07:00.752+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:07:00.753440965Z [2024-07-04T02:07:00.753+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:07:00.753470213Z 2024-07-04T02:07:00.753501509Z 2024-07-04T02:07:00.756411159Z [2024-07-04T02:07:00.755+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:07:00.756436916Z [2024-07-04T02:07:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:07:00.756775139Z [2024-07-04T02:07:00.756+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:07:00.756789160Z [2024-07-04T02:07:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:07:01.108014593Z [2024-07-04T02:07:01.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:06:00+00:00 exited with status queued for try_number 1 2024-07-04T02:07:01.108156884Z [2024-07-04T02:07:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:06:00+00:00 exited with status queued for try_number 1 2024-07-04T02:07:01.130440614Z [2024-07-04T02:07:01.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39864c62-7f1f-47a7-90cb-cbfa1cc37456 2024-07-04T02:07:01.130652848Z [2024-07-04T02:07:01.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to cefaf9a1-2bc7-4781-a955-6578428ac74e 2024-07-04T02:07:04.898105394Z [2024-07-04T02:07:04.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:07:04.898914710Z [2024-07-04T02:07:04.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:06:00+00:00, run_id=scheduled__2024-07-04T02:06:00+00:00, run_start_date=2024-07-04 02:07:00.710822+00:00, run_end_date=2024-07-04 02:07:04.898331+00:00, run_duration=4.187509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:06:00+00:00, data_interval_end=2024-07-04 02:07:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:07:04.910019168Z [2024-07-04T02:07:04.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:07:00+00:00, run_after=2024-07-04T02:08:00+00:00 2024-07-04T02:07:06.007625928Z [2024-07-04T02:07:06.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:07:06.008189962Z [2024-07-04T02:07:06.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:06:00+00:00, run_id=scheduled__2024-07-04T02:06:00+00:00, run_start_date=2024-07-04 02:07:00.709335+00:00, run_end_date=2024-07-04 02:07:06.007837+00:00, run_duration=5.298502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:06:00+00:00, data_interval_end=2024-07-04 02:07:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:07:06.019626960Z [2024-07-04T02:07:06.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:07:00+00:00, run_after=2024-07-04T02:08:00+00:00 2024-07-04T02:07:06.056346535Z [2024-07-04T02:07:06.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:06:00+00:00 exited with status success for try_number 1 2024-07-04T02:07:06.056811313Z [2024-07-04T02:07:06.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:06:00+00:00 exited with status success for try_number 1 2024-07-04T02:07:06.064966192Z [2024-07-04T02:07:06.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:06:00+00:00, map_index=-1, run_start_date=2024-07-04 02:07:02.875692+00:00, run_end_date=2024-07-04 02:07:04.815020+00:00, run_duration=1.939328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:07:00.753878+00:00, queued_by_job_id=2, pid=3469 2024-07-04T02:07:06.066618204Z [2024-07-04T02:07:06.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:06:00+00:00, map_index=-1, run_start_date=2024-07-04 02:07:02.691856+00:00, run_end_date=2024-07-04 02:07:05.501531+00:00, run_duration=2.809675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:07:00.753878+00:00, queued_by_job_id=2, pid=3468 2024-07-04T02:08:00.180117401Z [2024-07-04T02:08:00.179+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:08:00.206424926Z [2024-07-04T02:08:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:08:00+00:00, run_after=2024-07-04T02:09:00+00:00 2024-07-04T02:08:00.222388805Z [2024-07-04T02:08:00.222+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:08:00.284328552Z [2024-07-04T02:08:00.283+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:08:00.284355422Z 2024-07-04T02:08:00.284360038Z 2024-07-04T02:08:00.284363271Z 2024-07-04T02:08:00.284386347Z [2024-07-04T02:08:00.284+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:08:00.284396256Z [2024-07-04T02:08:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:08:00.284501376Z [2024-07-04T02:08:00.284+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:08:00.285050680Z [2024-07-04T02:08:00.284+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:08:00.285061676Z 2024-07-04T02:08:00.285065468Z 2024-07-04T02:08:00.285068527Z 2024-07-04T02:08:00.288251942Z [2024-07-04T02:08:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:08:00.288341776Z [2024-07-04T02:08:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:08:00.288531276Z [2024-07-04T02:08:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:08:00.288583390Z [2024-07-04T02:08:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:08:00.288748478Z [2024-07-04T02:08:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:08:00.288811644Z [2024-07-04T02:08:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:08:00.893119047Z [2024-07-04T02:08:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:06:00+00:00 exited with status queued for try_number 1 2024-07-04T02:08:00.893486678Z [2024-07-04T02:08:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:07:00+00:00 exited with status queued for try_number 1 2024-07-04T02:08:00.893700899Z [2024-07-04T02:08:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:07:00+00:00 exited with status queued for try_number 1 2024-07-04T02:08:00.918966424Z [2024-07-04T02:08:00.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39843675-9611-4791-9c1e-85663cf89f5b 2024-07-04T02:08:00.923556619Z [2024-07-04T02:08:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20adb141-f9db-44dd-8daa-bdc75ef92d0d 2024-07-04T02:08:00.923969010Z [2024-07-04T02:08:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea5fdcf2-ebfc-43eb-9d03-376c9ad5b496 2024-07-04T02:08:03.024228992Z [2024-07-04T02:08:03.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:08:03.024634703Z [2024-07-04T02:08:03.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:06:00+00:00, run_id=scheduled__2024-07-04T02:06:00+00:00, run_start_date=2024-07-04 02:08:00.235885+00:00, run_end_date=2024-07-04 02:08:03.024213+00:00, run_duration=2.788328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:06:00+00:00, data_interval_end=2024-07-04 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:08:03.035690075Z [2024-07-04T02:08:03.035+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:08:00+00:00, run_after=2024-07-04T02:10:00+00:00 2024-07-04T02:08:03.082439447Z [2024-07-04T02:08:03.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:06:00+00:00 exited with status success for try_number 1 2024-07-04T02:08:03.089317133Z [2024-07-04T02:08:03.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:06:00+00:00, map_index=-1, run_start_date=2024-07-04 02:08:02.317092+00:00, run_end_date=2024-07-04 02:08:02.724612+00:00, run_duration=0.40752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:08:00.285655+00:00, queued_by_job_id=2, pid=3505 2024-07-04T02:08:05.256914941Z [2024-07-04T02:08:05.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:08:05.257731730Z [2024-07-04T02:08:05.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:07:00+00:00, run_id=scheduled__2024-07-04T02:07:00+00:00, run_start_date=2024-07-04 02:08:00.237423+00:00, run_end_date=2024-07-04 02:08:05.256670+00:00, run_duration=5.019247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:07:00+00:00, data_interval_end=2024-07-04 02:08:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:08:05.277333306Z [2024-07-04T02:08:05.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:08:00+00:00, run_after=2024-07-04T02:09:00+00:00 2024-07-04T02:08:05.324707274Z [2024-07-04T02:08:05.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:07:00+00:00 exited with status success for try_number 1 2024-07-04T02:08:05.330658448Z [2024-07-04T02:08:05.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:07:00+00:00, map_index=-1, run_start_date=2024-07-04 02:08:03.090856+00:00, run_end_date=2024-07-04 02:08:04.707075+00:00, run_duration=1.616219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:08:00.285655+00:00, queued_by_job_id=2, pid=3525 2024-07-04T02:08:06.376414027Z [2024-07-04T02:08:06.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:08:06.376576361Z [2024-07-04T02:08:06.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:07:00+00:00, run_id=scheduled__2024-07-04T02:07:00+00:00, run_start_date=2024-07-04 02:08:00.238455+00:00, run_end_date=2024-07-04 02:08:06.376227+00:00, run_duration=6.137772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:07:00+00:00, data_interval_end=2024-07-04 02:08:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:08:06.391081218Z [2024-07-04T02:08:06.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:08:00+00:00, run_after=2024-07-04T02:09:00+00:00 2024-07-04T02:08:06.422136859Z [2024-07-04T02:08:06.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:07:00+00:00 exited with status success for try_number 1 2024-07-04T02:08:06.429088135Z [2024-07-04T02:08:06.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:07:00+00:00, map_index=-1, run_start_date=2024-07-04 02:08:03.729834+00:00, run_end_date=2024-07-04 02:08:05.705312+00:00, run_duration=1.975478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:08:00.285655+00:00, queued_by_job_id=2, pid=3544 2024-07-04T02:09:00.207860627Z [2024-07-04T02:09:00.207+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:09:00.226343947Z [2024-07-04T02:09:00.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:09:00+00:00, run_after=2024-07-04T02:10:00+00:00 2024-07-04T02:09:00.293708627Z [2024-07-04T02:09:00.293+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:09:00.293751217Z 2024-07-04T02:09:00.293757199Z 2024-07-04T02:09:00.293834844Z [2024-07-04T02:09:00.293+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:09:00.293887995Z [2024-07-04T02:09:00.293+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:09:00.294588658Z [2024-07-04T02:09:00.294+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:09:00.294604645Z 2024-07-04T02:09:00.294610124Z 2024-07-04T02:09:00.298469904Z [2024-07-04T02:09:00.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:09:00.298636844Z [2024-07-04T02:09:00.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:09:00.298925680Z [2024-07-04T02:09:00.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:09:00.299070640Z [2024-07-04T02:09:00.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:09:00.537378085Z [2024-07-04T02:09:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:08:00+00:00 exited with status queued for try_number 1 2024-07-04T02:09:00.539669529Z [2024-07-04T02:09:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:08:00+00:00 exited with status queued for try_number 1 2024-07-04T02:09:00.560429581Z [2024-07-04T02:09:00.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to a336fe57-950c-47da-9842-16cace578173 2024-07-04T02:09:00.560866627Z [2024-07-04T02:09:00.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b57fd0f-e37b-4904-8d02-d6e4eccb50a4 2024-07-04T02:09:04.491668765Z [2024-07-04T02:09:04.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:09:04.492137213Z [2024-07-04T02:09:04.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:08:00+00:00, run_id=scheduled__2024-07-04T02:08:00+00:00, run_start_date=2024-07-04 02:09:00.243128+00:00, run_end_date=2024-07-04 02:09:04.491568+00:00, run_duration=4.24844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:08:00+00:00, data_interval_end=2024-07-04 02:09:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:09:04.502770949Z [2024-07-04T02:09:04.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:09:00+00:00, run_after=2024-07-04T02:10:00+00:00 2024-07-04T02:09:04.565333605Z [2024-07-04T02:09:04.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:08:00+00:00 exited with status success for try_number 1 2024-07-04T02:09:04.573189679Z [2024-07-04T02:09:04.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:08:00+00:00, map_index=-1, run_start_date=2024-07-04 02:09:02.808402+00:00, run_end_date=2024-07-04 02:09:04.257615+00:00, run_duration=1.449213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:09:00.295502+00:00, queued_by_job_id=2, pid=3590 2024-07-04T02:09:05.636282038Z [2024-07-04T02:09:05.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:09:05.636914770Z [2024-07-04T02:09:05.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:08:00+00:00, run_id=scheduled__2024-07-04T02:08:00+00:00, run_start_date=2024-07-04 02:09:00.241365+00:00, run_end_date=2024-07-04 02:09:05.636141+00:00, run_duration=5.394776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:08:00+00:00, data_interval_end=2024-07-04 02:09:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:09:05.652008879Z [2024-07-04T02:09:05.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:09:00+00:00, run_after=2024-07-04T02:10:00+00:00 2024-07-04T02:09:05.711282829Z [2024-07-04T02:09:05.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:08:00+00:00 exited with status success for try_number 1 2024-07-04T02:09:05.718100110Z [2024-07-04T02:09:05.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:08:00+00:00, map_index=-1, run_start_date=2024-07-04 02:09:02.676746+00:00, run_end_date=2024-07-04 02:09:04.613189+00:00, run_duration=1.936443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:09:00.295502+00:00, queued_by_job_id=2, pid=3589 2024-07-04T02:10:00.080955645Z [2024-07-04T02:10:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:10:00+00:00, run_after=2024-07-04T02:11:00+00:00 2024-07-04T02:10:00.092403359Z [2024-07-04T02:10:00.091+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:10:00.099695066Z [2024-07-04T02:10:00.099+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:10:00.114226504Z [2024-07-04T02:10:00.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:10:00+00:00, run_after=2024-07-04T02:15:00+00:00 2024-07-04T02:10:00.222655938Z [2024-07-04T02:10:00.222+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T02:10:00.222689044Z 2024-07-04T02:10:00.222694728Z 2024-07-04T02:10:00.222703524Z 2024-07-04T02:10:00.222709175Z 2024-07-04T02:10:00.223074303Z [2024-07-04T02:10:00.222+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:10:00.223476213Z [2024-07-04T02:10:00.223+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:10:00.223820453Z [2024-07-04T02:10:00.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:10:00.224289966Z [2024-07-04T02:10:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:10:00.225690812Z [2024-07-04T02:10:00.225+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:10:00.225707748Z 2024-07-04T02:10:00.225715191Z 2024-07-04T02:10:00.225720817Z 2024-07-04T02:10:00.225726146Z 2024-07-04T02:10:00.231542695Z [2024-07-04T02:10:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:10:00.231681407Z [2024-07-04T02:10:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:10:00.231975312Z [2024-07-04T02:10:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:10:00.232214968Z [2024-07-04T02:10:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:10:00.232614527Z [2024-07-04T02:10:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:10:00.232777070Z [2024-07-04T02:10:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:10:00.232991728Z [2024-07-04T02:10:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:10:00.233115373Z [2024-07-04T02:10:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:10:00.908052234Z [2024-07-04T02:10:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status queued for try_number 1 2024-07-04T02:10:00.908126399Z [2024-07-04T02:10:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:08:00+00:00 exited with status queued for try_number 1 2024-07-04T02:10:00.908132186Z [2024-07-04T02:10:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:09:00+00:00 exited with status queued for try_number 1 2024-07-04T02:10:00.908258310Z [2024-07-04T02:10:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:09:00+00:00 exited with status queued for try_number 1 2024-07-04T02:10:00.926184469Z [2024-07-04T02:10:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36572318-ec5e-4837-9817-31fe4c1429e0 2024-07-04T02:10:00.926287533Z [2024-07-04T02:10:00.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5be91dab-4a28-4799-a416-64ac78f9e2c9 2024-07-04T02:10:00.926487971Z [2024-07-04T02:10:00.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0da2924-743c-46bb-aff3-5d964d083c2c 2024-07-04T02:10:00.926756649Z [2024-07-04T02:10:00.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c6cfdfc-74c2-41c9-b335-ade8894d7731 2024-07-04T02:10:02.386644354Z [2024-07-04T02:10:02.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:10:02.387346507Z [2024-07-04T02:10:02.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:08:00+00:00, run_id=scheduled__2024-07-04T02:08:00+00:00, run_start_date=2024-07-04 02:10:00.128988+00:00, run_end_date=2024-07-04 02:10:02.386706+00:00, run_duration=2.257718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:08:00+00:00, data_interval_end=2024-07-04 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:10:02.400874102Z [2024-07-04T02:10:02.400+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:10:00+00:00, run_after=2024-07-04T02:12:00+00:00 2024-07-04T02:10:02.543829907Z [2024-07-04T02:10:02.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:08:00+00:00 exited with status success for try_number 1 2024-07-04T02:10:02.560524203Z [2024-07-04T02:10:02.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:08:00+00:00, map_index=-1, run_start_date=2024-07-04 02:10:01.288843+00:00, run_end_date=2024-07-04 02:10:01.806753+00:00, run_duration=0.51791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:10:00.227249+00:00, queued_by_job_id=2, pid=3627 2024-07-04T02:10:03.686927390Z [2024-07-04T02:10:03.686+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:10:03.687006083Z 2024-07-04T02:10:03.687033068Z [2024-07-04T02:10:03.686+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:10:03.687874983Z [2024-07-04T02:10:03.687+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:10:03.687908559Z 2024-07-04T02:10:03.691582309Z [2024-07-04T02:10:03.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:10:03.691630158Z [2024-07-04T02:10:03.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:10:03.781315038Z [2024-07-04T02:10:03.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status queued for try_number 1 2024-07-04T02:10:03.781734962Z [2024-07-04T02:10:03.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status success for try_number 1 2024-07-04T02:10:03.796945754Z [2024-07-04T02:10:03.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to d60abc78-1b38-43e2-b800-a2b010d9d1c4 2024-07-04T02:10:03.797243329Z [2024-07-04T02:10:03.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:05:00+00:00, map_index=-1, run_start_date=2024-07-04 02:10:02.637921+00:00, run_end_date=2024-07-04 02:10:03.032937+00:00, run_duration=0.395016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:10:00.227249+00:00, queued_by_job_id=2, pid=3658 2024-07-04T02:10:05.212855014Z [2024-07-04T02:10:05.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:10:05.213017699Z [2024-07-04T02:10:05.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:09:00+00:00, run_id=scheduled__2024-07-04T02:09:00+00:00, run_start_date=2024-07-04 02:10:00.130597+00:00, run_end_date=2024-07-04 02:10:05.212776+00:00, run_duration=5.082179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:09:00+00:00, data_interval_end=2024-07-04 02:10:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:10:05.222634847Z [2024-07-04T02:10:05.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:10:00+00:00, run_after=2024-07-04T02:11:00+00:00 2024-07-04T02:10:05.230127021Z [2024-07-04T02:10:05.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:10:05.230367563Z [2024-07-04T02:10:05.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:09:00+00:00, run_id=scheduled__2024-07-04T02:09:00+00:00, run_start_date=2024-07-04 02:10:00.135603+00:00, run_end_date=2024-07-04 02:10:05.230033+00:00, run_duration=5.09443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:09:00+00:00, data_interval_end=2024-07-04 02:10:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:10:05.243561524Z [2024-07-04T02:10:05.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:10:00+00:00, run_after=2024-07-04T02:11:00+00:00 2024-07-04T02:10:05.324132721Z [2024-07-04T02:10:05.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:09:00+00:00 exited with status success for try_number 1 2024-07-04T02:10:05.324609336Z [2024-07-04T02:10:05.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:09:00+00:00 exited with status success for try_number 1 2024-07-04T02:10:05.335714165Z [2024-07-04T02:10:05.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:09:00+00:00, map_index=-1, run_start_date=2024-07-04 02:10:03.155576+00:00, run_end_date=2024-07-04 02:10:04.949356+00:00, run_duration=1.79378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:10:00.227249+00:00, queued_by_job_id=2, pid=3678 2024-07-04T02:10:05.335967215Z [2024-07-04T02:10:05.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:09:00+00:00, map_index=-1, run_start_date=2024-07-04 02:10:02.823300+00:00, run_end_date=2024-07-04 02:10:05.023253+00:00, run_duration=2.199953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:10:00.227249+00:00, queued_by_job_id=2, pid=3659 2024-07-04T02:10:06.415261698Z [2024-07-04T02:10:06.414+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:10:06.415289393Z 2024-07-04T02:10:06.422327483Z [2024-07-04T02:10:06.422+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:10:06.423068900Z [2024-07-04T02:10:06.422+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:10:06.423082236Z 2024-07-04T02:10:06.426032901Z [2024-07-04T02:10:06.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:10:06.426238160Z [2024-07-04T02:10:06.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:10:06.546905922Z [2024-07-04T02:10:06.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status queued for try_number 1 2024-07-04T02:10:06.550109749Z [2024-07-04T02:10:06.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status success for try_number 1 2024-07-04T02:10:06.556050137Z [2024-07-04T02:10:06.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74f9d25e-ed8c-4c90-a27c-e0676ba47128 2024-07-04T02:10:06.556302701Z [2024-07-04T02:10:06.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:05:00+00:00, map_index=-1, run_start_date=2024-07-04 02:10:05.442660+00:00, run_end_date=2024-07-04 02:10:05.861792+00:00, run_duration=0.419132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:10:03.688271+00:00, queued_by_job_id=2, pid=3708 2024-07-04T02:10:08.885820262Z [2024-07-04T02:10:08.885+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:10:08.885868609Z 2024-07-04T02:10:08.885964964Z [2024-07-04T02:10:08.885+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:10:08.886678041Z [2024-07-04T02:10:08.886+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:10:08.886694819Z 2024-07-04T02:10:08.889676858Z [2024-07-04T02:10:08.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:10:08.890151499Z [2024-07-04T02:10:08.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:10:08.982603167Z [2024-07-04T02:10:08.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status queued for try_number 1 2024-07-04T02:10:08.983187251Z [2024-07-04T02:10:08.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status success for try_number 1 2024-07-04T02:10:08.995864913Z [2024-07-04T02:10:08.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77ad0ebd-d03b-46f5-9c92-ba66a0bd8826 2024-07-04T02:10:08.996470926Z [2024-07-04T02:10:08.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:05:00+00:00, map_index=0, run_start_date=2024-07-04 02:10:08.189834+00:00, run_end_date=2024-07-04 02:10:08.513955+00:00, run_duration=0.324121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:10:06.423514+00:00, queued_by_job_id=2, pid=3720 2024-07-04T02:10:11.374784431Z [2024-07-04T02:10:11.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:10:11.375018348Z [2024-07-04T02:10:11.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:05:00+00:00, run_id=scheduled__2024-07-04T02:05:00+00:00, run_start_date=2024-07-04 02:10:00.126702+00:00, run_end_date=2024-07-04 02:10:11.374496+00:00, run_duration=11.247794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:05:00+00:00, data_interval_end=2024-07-04 02:10:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:10:11.380873204Z [2024-07-04T02:10:11.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:10:00+00:00, run_after=2024-07-04T02:15:00+00:00 2024-07-04T02:10:11.415899725Z [2024-07-04T02:10:11.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:05:00+00:00 exited with status success for try_number 1 2024-07-04T02:10:11.427257607Z [2024-07-04T02:10:11.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:05:00+00:00, map_index=-1, run_start_date=2024-07-04 02:10:10.622083+00:00, run_end_date=2024-07-04 02:10:11.067672+00:00, run_duration=0.445589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:10:08.887231+00:00, queued_by_job_id=2, pid=3732 2024-07-04T02:11:00.068422713Z [2024-07-04T02:11:00.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:11:00.083174005Z [2024-07-04T02:11:00.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:11:00+00:00, run_after=2024-07-04T02:12:00+00:00 2024-07-04T02:11:00.153409776Z [2024-07-04T02:11:00.153+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:11:00.153443433Z 2024-07-04T02:11:00.153449348Z 2024-07-04T02:11:00.153454797Z [2024-07-04T02:11:00.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:11:00.153509378Z [2024-07-04T02:11:00.153+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:11:00.154197241Z [2024-07-04T02:11:00.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:11:00.154207834Z 2024-07-04T02:11:00.154213215Z 2024-07-04T02:11:00.159658093Z [2024-07-04T02:11:00.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:11:00.159848413Z [2024-07-04T02:11:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:11:00.160091666Z [2024-07-04T02:11:00.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:11:00.160208976Z [2024-07-04T02:11:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:11:00.400028516Z [2024-07-04T02:11:00.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status queued for try_number 1 2024-07-04T02:11:00.400071282Z [2024-07-04T02:11:00.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status queued for try_number 1 2024-07-04T02:11:00.429652520Z [2024-07-04T02:11:00.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56507081-e53b-484b-b400-490b6b2916fe 2024-07-04T02:11:00.429699471Z [2024-07-04T02:11:00.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to c49e112e-3355-4124-be92-7329d55b5d6a 2024-07-04T02:11:04.031466793Z [2024-07-04T02:11:04.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:11:04.032163486Z [2024-07-04T02:11:04.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:10:00+00:00, run_id=scheduled__2024-07-04T02:10:00+00:00, run_start_date=2024-07-04 02:11:00.097407+00:00, run_end_date=2024-07-04 02:11:04.031304+00:00, run_duration=3.933897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:10:00+00:00, data_interval_end=2024-07-04 02:11:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:11:04.044512822Z [2024-07-04T02:11:04.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:11:00+00:00, run_after=2024-07-04T02:12:00+00:00 2024-07-04T02:11:04.051180664Z [2024-07-04T02:11:04.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:11:04.051546917Z [2024-07-04T02:11:04.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:10:00+00:00, run_id=scheduled__2024-07-04T02:10:00+00:00, run_start_date=2024-07-04 02:11:00.099642+00:00, run_end_date=2024-07-04 02:11:04.051089+00:00, run_duration=3.951447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:10:00+00:00, data_interval_end=2024-07-04 02:11:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:11:04.060850611Z [2024-07-04T02:11:04.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:11:00+00:00, run_after=2024-07-04T02:12:00+00:00 2024-07-04T02:11:04.092919595Z [2024-07-04T02:11:04.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status success for try_number 1 2024-07-04T02:11:04.092965848Z [2024-07-04T02:11:04.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status success for try_number 1 2024-07-04T02:11:04.098818057Z [2024-07-04T02:11:04.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:10:00+00:00, map_index=-1, run_start_date=2024-07-04 02:11:02.156527+00:00, run_end_date=2024-07-04 02:11:03.810713+00:00, run_duration=1.654186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:11:00.154863+00:00, queued_by_job_id=2, pid=3769 2024-07-04T02:11:04.099155180Z [2024-07-04T02:11:04.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:10:00+00:00, map_index=-1, run_start_date=2024-07-04 02:11:02.077887+00:00, run_end_date=2024-07-04 02:11:03.467862+00:00, run_duration=1.389975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:11:00.154863+00:00, queued_by_job_id=2, pid=3768 2024-07-04T02:11:21.525630747Z [2024-07-04T02:11:21.525+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:12:00.623936490Z [2024-07-04T02:12:00.619+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:12:00.645653249Z [2024-07-04T02:12:00.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:12:00+00:00, run_after=2024-07-04T02:13:00+00:00 2024-07-04T02:12:00.654175067Z [2024-07-04T02:12:00.653+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:12:00.731024499Z [2024-07-04T02:12:00.730+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:12:00.731054483Z 2024-07-04T02:12:00.731060114Z 2024-07-04T02:12:00.731064920Z 2024-07-04T02:12:00.731246828Z [2024-07-04T02:12:00.731+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:12:00.731438978Z [2024-07-04T02:12:00.731+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:12:00.731680012Z [2024-07-04T02:12:00.731+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:12:00.732501402Z [2024-07-04T02:12:00.732+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:12:00.732518713Z 2024-07-04T02:12:00.732524952Z 2024-07-04T02:12:00.732529775Z 2024-07-04T02:12:00.741796468Z [2024-07-04T02:12:00.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:12:00.742094872Z [2024-07-04T02:12:00.741+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:12:00.742598912Z [2024-07-04T02:12:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:12:00.742910685Z [2024-07-04T02:12:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:12:00.743377981Z [2024-07-04T02:12:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:12:00.743790753Z [2024-07-04T02:12:00.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:12:01.039043627Z [2024-07-04T02:12:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status queued for try_number 1 2024-07-04T02:12:01.041202362Z [2024-07-04T02:12:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:11:00+00:00 exited with status queued for try_number 1 2024-07-04T02:12:01.041455896Z [2024-07-04T02:12:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:11:00+00:00 exited with status queued for try_number 1 2024-07-04T02:12:01.049517034Z [2024-07-04T02:12:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to 978fde56-b91d-4dfa-8fec-376e3c87f4eb 2024-07-04T02:12:01.050200872Z [2024-07-04T02:12:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b9836be-64d8-4f35-a8f5-ee5a7549a8fd 2024-07-04T02:12:01.051089985Z [2024-07-04T02:12:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2cdfd55-73c1-4dfa-aa48-6ee3b009358c 2024-07-04T02:12:02.593977697Z [2024-07-04T02:12:02.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:12:02.595252462Z [2024-07-04T02:12:02.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:10:00+00:00, run_id=scheduled__2024-07-04T02:10:00+00:00, run_start_date=2024-07-04 02:12:00.666116+00:00, run_end_date=2024-07-04 02:12:02.593842+00:00, run_duration=1.927726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:10:00+00:00, data_interval_end=2024-07-04 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:12:02.608821635Z [2024-07-04T02:12:02.608+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:12:00+00:00, run_after=2024-07-04T02:14:00+00:00 2024-07-04T02:12:02.670317033Z [2024-07-04T02:12:02.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status success for try_number 1 2024-07-04T02:12:02.675678712Z [2024-07-04T02:12:02.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:10:00+00:00, map_index=-1, run_start_date=2024-07-04 02:12:01.655372+00:00, run_end_date=2024-07-04 02:12:02.030478+00:00, run_duration=0.375106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:12:00.734014+00:00, queued_by_job_id=2, pid=3804 2024-07-04T02:12:05.457485381Z [2024-07-04T02:12:05.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:12:05.458106100Z [2024-07-04T02:12:05.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:11:00+00:00, run_id=scheduled__2024-07-04T02:11:00+00:00, run_start_date=2024-07-04 02:12:00.668934+00:00, run_end_date=2024-07-04 02:12:05.457634+00:00, run_duration=4.7887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:11:00+00:00, data_interval_end=2024-07-04 02:12:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:12:05.470181107Z [2024-07-04T02:12:05.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:12:00+00:00, run_after=2024-07-04T02:13:00+00:00 2024-07-04T02:12:05.510909671Z [2024-07-04T02:12:05.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:11:00+00:00 exited with status success for try_number 1 2024-07-04T02:12:05.517601279Z [2024-07-04T02:12:05.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:11:00+00:00, map_index=-1, run_start_date=2024-07-04 02:12:02.639928+00:00, run_end_date=2024-07-04 02:12:04.807992+00:00, run_duration=2.168064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:12:00.734014+00:00, queued_by_job_id=2, pid=3835 2024-07-04T02:12:06.582944599Z [2024-07-04T02:12:06.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:12:06.583506066Z [2024-07-04T02:12:06.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:11:00+00:00, run_id=scheduled__2024-07-04T02:11:00+00:00, run_start_date=2024-07-04 02:12:00.667767+00:00, run_end_date=2024-07-04 02:12:06.582687+00:00, run_duration=5.91492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:11:00+00:00, data_interval_end=2024-07-04 02:12:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:12:06.596715764Z [2024-07-04T02:12:06.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:12:00+00:00, run_after=2024-07-04T02:13:00+00:00 2024-07-04T02:12:06.635841477Z [2024-07-04T02:12:06.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:11:00+00:00 exited with status success for try_number 1 2024-07-04T02:12:06.643014988Z [2024-07-04T02:12:06.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:11:00+00:00, map_index=-1, run_start_date=2024-07-04 02:12:02.613863+00:00, run_end_date=2024-07-04 02:12:05.535097+00:00, run_duration=2.921234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:12:00.734014+00:00, queued_by_job_id=2, pid=3834 2024-07-04T02:13:00.666789631Z [2024-07-04T02:13:00.665+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:13:00.689829587Z [2024-07-04T02:13:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:13:00+00:00, run_after=2024-07-04T02:14:00+00:00 2024-07-04T02:13:00.755086753Z [2024-07-04T02:13:00.754+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:13:00.755119423Z 2024-07-04T02:13:00.755125117Z 2024-07-04T02:13:00.755285356Z [2024-07-04T02:13:00.755+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:13:00.755507868Z [2024-07-04T02:13:00.755+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:13:00.756199479Z [2024-07-04T02:13:00.756+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:13:00.756212896Z 2024-07-04T02:13:00.756216293Z 2024-07-04T02:13:00.759650952Z [2024-07-04T02:13:00.759+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:13:00.759954969Z [2024-07-04T02:13:00.759+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:13:00.760337933Z [2024-07-04T02:13:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:13:00.760566923Z [2024-07-04T02:13:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:13:01.056855416Z [2024-07-04T02:13:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:12:00+00:00 exited with status queued for try_number 1 2024-07-04T02:13:01.056960729Z [2024-07-04T02:13:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:12:00+00:00 exited with status queued for try_number 1 2024-07-04T02:13:01.067124533Z [2024-07-04T02:13:01.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to acc0b261-7b25-4ebb-a9ee-3d7caf328684 2024-07-04T02:13:01.067274097Z [2024-07-04T02:13:01.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96460625-dde1-4464-bcb2-bf22ac0903ba 2024-07-04T02:13:04.643936492Z [2024-07-04T02:13:04.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:13:04.644241026Z [2024-07-04T02:13:04.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:12:00+00:00, run_id=scheduled__2024-07-04T02:12:00+00:00, run_start_date=2024-07-04 02:13:00.704372+00:00, run_end_date=2024-07-04 02:13:04.643853+00:00, run_duration=3.939481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:12:00+00:00, data_interval_end=2024-07-04 02:13:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:13:04.654827617Z [2024-07-04T02:13:04.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:13:00+00:00, run_after=2024-07-04T02:14:00+00:00 2024-07-04T02:13:04.703751612Z [2024-07-04T02:13:04.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:12:00+00:00 exited with status success for try_number 1 2024-07-04T02:13:04.710037075Z [2024-07-04T02:13:04.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:12:00+00:00, map_index=-1, run_start_date=2024-07-04 02:13:02.871616+00:00, run_end_date=2024-07-04 02:13:04.474264+00:00, run_duration=1.602648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:13:00.756978+00:00, queued_by_job_id=2, pid=3890 2024-07-04T02:13:05.764327749Z [2024-07-04T02:13:05.763+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:13:05.764522776Z [2024-07-04T02:13:05.764+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:12:00+00:00, run_id=scheduled__2024-07-04T02:12:00+00:00, run_start_date=2024-07-04 02:13:00.703037+00:00, run_end_date=2024-07-04 02:13:05.764140+00:00, run_duration=5.061103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:12:00+00:00, data_interval_end=2024-07-04 02:13:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:13:05.780988329Z [2024-07-04T02:13:05.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:13:00+00:00, run_after=2024-07-04T02:14:00+00:00 2024-07-04T02:13:05.822049987Z [2024-07-04T02:13:05.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:12:00+00:00 exited with status success for try_number 1 2024-07-04T02:13:05.829098457Z [2024-07-04T02:13:05.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:12:00+00:00, map_index=-1, run_start_date=2024-07-04 02:13:02.843037+00:00, run_end_date=2024-07-04 02:13:05.426317+00:00, run_duration=2.58328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:13:00.756978+00:00, queued_by_job_id=2, pid=3889 2024-07-04T02:14:00.485104036Z [2024-07-04T02:14:00.484+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:14:00.492411235Z [2024-07-04T02:14:00.492+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:14:00.505676232Z [2024-07-04T02:14:00.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:14:00+00:00, run_after=2024-07-04T02:15:00+00:00 2024-07-04T02:14:00.579690762Z [2024-07-04T02:14:00.579+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:14:00.579721408Z 2024-07-04T02:14:00.579725963Z 2024-07-04T02:14:00.579729293Z 2024-07-04T02:14:00.579983888Z [2024-07-04T02:14:00.579+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:14:00.580331539Z [2024-07-04T02:14:00.580+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:14:00.580546088Z [2024-07-04T02:14:00.580+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:14:00.581218067Z [2024-07-04T02:14:00.581+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:14:00.581229304Z 2024-07-04T02:14:00.581233487Z 2024-07-04T02:14:00.581236597Z 2024-07-04T02:14:00.584907627Z [2024-07-04T02:14:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:14:00.585175482Z [2024-07-04T02:14:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:14:00.585477335Z [2024-07-04T02:14:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:14:00.585634349Z [2024-07-04T02:14:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:14:00.585911391Z [2024-07-04T02:14:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:14:00.586065424Z [2024-07-04T02:14:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:14:01.136027177Z [2024-07-04T02:14:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:12:00+00:00 exited with status queued for try_number 1 2024-07-04T02:14:01.136122832Z [2024-07-04T02:14:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:13:00+00:00 exited with status queued for try_number 1 2024-07-04T02:14:01.136243818Z [2024-07-04T02:14:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:13:00+00:00 exited with status queued for try_number 1 2024-07-04T02:14:01.148252015Z [2024-07-04T02:14:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 375f53bc-9b72-4f4b-8665-a60d0c79f180 2024-07-04T02:14:01.148499738Z [2024-07-04T02:14:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2557dc1d-c3cf-4e40-aa81-a2632755a8a6 2024-07-04T02:14:01.148729718Z [2024-07-04T02:14:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96f27ae3-b0ab-4643-991d-c9f4dbac8163 2024-07-04T02:14:02.322719835Z [2024-07-04T02:14:02.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:14:02.323427129Z [2024-07-04T02:14:02.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:12:00+00:00, run_id=scheduled__2024-07-04T02:12:00+00:00, run_start_date=2024-07-04 02:14:00.516027+00:00, run_end_date=2024-07-04 02:14:02.323013+00:00, run_duration=1.806986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:12:00+00:00, data_interval_end=2024-07-04 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:14:02.332371209Z [2024-07-04T02:14:02.332+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:14:00+00:00, run_after=2024-07-04T02:16:00+00:00 2024-07-04T02:14:02.376937595Z [2024-07-04T02:14:02.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:12:00+00:00 exited with status success for try_number 1 2024-07-04T02:14:02.396115376Z [2024-07-04T02:14:02.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:12:00+00:00, map_index=-1, run_start_date=2024-07-04 02:14:01.626697+00:00, run_end_date=2024-07-04 02:14:01.988995+00:00, run_duration=0.362298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:14:00.582038+00:00, queued_by_job_id=2, pid=3925 2024-07-04T02:14:04.570441192Z [2024-07-04T02:14:04.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:14:04.571146395Z [2024-07-04T02:14:04.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:13:00+00:00, run_id=scheduled__2024-07-04T02:13:00+00:00, run_start_date=2024-07-04 02:14:00.518586+00:00, run_end_date=2024-07-04 02:14:04.570395+00:00, run_duration=4.051809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:13:00+00:00, data_interval_end=2024-07-04 02:14:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:14:04.583827714Z [2024-07-04T02:14:04.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:14:00+00:00, run_after=2024-07-04T02:15:00+00:00 2024-07-04T02:14:04.628334092Z [2024-07-04T02:14:04.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:13:00+00:00 exited with status success for try_number 1 2024-07-04T02:14:04.639962099Z [2024-07-04T02:14:04.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:13:00+00:00, map_index=-1, run_start_date=2024-07-04 02:14:02.689039+00:00, run_end_date=2024-07-04 02:14:04.261703+00:00, run_duration=1.572664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:14:00.582038+00:00, queued_by_job_id=2, pid=3954 2024-07-04T02:14:06.061081734Z [2024-07-04T02:14:06.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:14:06.061406025Z [2024-07-04T02:14:06.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:13:00+00:00, run_id=scheduled__2024-07-04T02:13:00+00:00, run_start_date=2024-07-04 02:14:00.517540+00:00, run_end_date=2024-07-04 02:14:06.061056+00:00, run_duration=5.543516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:13:00+00:00, data_interval_end=2024-07-04 02:14:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:14:06.070219050Z [2024-07-04T02:14:06.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:14:00+00:00, run_after=2024-07-04T02:15:00+00:00 2024-07-04T02:14:06.101371204Z [2024-07-04T02:14:06.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:13:00+00:00 exited with status success for try_number 1 2024-07-04T02:14:06.109412507Z [2024-07-04T02:14:06.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:13:00+00:00, map_index=-1, run_start_date=2024-07-04 02:14:02.797762+00:00, run_end_date=2024-07-04 02:14:05.383384+00:00, run_duration=2.585622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:14:00.582038+00:00, queued_by_job_id=2, pid=3955 2024-07-04T02:14:42.231332817Z [2024-07-04T02:14:42.230+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf to 2024-07-04T02:14:00+00:00, run_after=2024-07-04T02:15:00+00:00 2024-07-04T02:14:42.277458951Z [2024-07-04T02:14:42.277+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:14:42.277501229Z 2024-07-04T02:14:42.277507774Z [2024-07-04T02:14:42.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf has 0/16 running and queued tasks 2024-07-04T02:14:42.278118050Z [2024-07-04T02:14:42.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:14:42.278154632Z 2024-07-04T02:14:42.282449910Z [2024-07-04T02:14:42.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:14:42.282586063Z [2024-07-04T02:14:42.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-07-04T02:14:42.335010751Z [2024-07-04T02:14:42.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:13:00+00:00 exited with status queued for try_number 1 2024-07-04T02:14:42.341053671Z [2024-07-04T02:14:42.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a4e9a6e-ee8b-41c3-a236-4c2abe1f6295 2024-07-04T02:14:44.116988704Z [2024-07-04T02:14:44.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:14:44.117232164Z [2024-07-04T02:14:44.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf, execution_date=2024-07-04 02:13:00+00:00, run_id=scheduled__2024-07-04T02:13:00+00:00, run_start_date=2024-07-04 02:14:42.241788+00:00, run_end_date=2024-07-04 02:14:44.116773+00:00, run_duration=1.874985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:13:00+00:00, data_interval_end=2024-07-04 02:14:00+00:00, dag_hash=c534dacb3905b64bd83a2b2d6f5f3b77 2024-07-04T02:14:44.126644976Z [2024-07-04T02:14:44.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf to 2024-07-04T02:14:00+00:00, run_after=2024-07-04T02:15:00+00:00 2024-07-04T02:14:44.176380985Z [2024-07-04T02:14:44.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:13:00+00:00 exited with status success for try_number 1 2024-07-04T02:14:44.190062520Z [2024-07-04T02:14:44.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:13:00+00:00, map_index=-1, run_start_date=2024-07-04 02:14:43.098203+00:00, run_end_date=2024-07-04 02:14:43.485592+00:00, run_duration=0.387389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:14:42.278437+00:00, queued_by_job_id=2, pid=3984 2024-07-04T02:15:00.487825502Z [2024-07-04T02:15:00.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:15:00+00:00, run_after=2024-07-04T02:20:00+00:00 2024-07-04T02:15:00.498678169Z [2024-07-04T02:15:00.498+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:15:00.515903215Z [2024-07-04T02:15:00.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:15:00+00:00, run_after=2024-07-04T02:16:00+00:00 2024-07-04T02:15:00.533759275Z [2024-07-04T02:15:00.533+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf to 2024-07-04T02:15:00+00:00, run_after=2024-07-04T02:16:00+00:00 2024-07-04T02:15:00.646756628Z [2024-07-04T02:15:00.646+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T02:15:00.646789830Z 2024-07-04T02:15:00.646794849Z 2024-07-04T02:15:00.646798411Z 2024-07-04T02:15:00.646802538Z 2024-07-04T02:15:00.646875028Z [2024-07-04T02:15:00.646+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:15:00.646879723Z [2024-07-04T02:15:00.646+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf has 0/16 running and queued tasks 2024-07-04T02:15:00.649310035Z [2024-07-04T02:15:00.646+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:15:00.649477991Z [2024-07-04T02:15:00.649+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:15:00.650094837Z [2024-07-04T02:15:00.649+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:15:00.650107074Z 2024-07-04T02:15:00.650127834Z 2024-07-04T02:15:00.650131887Z 2024-07-04T02:15:00.650135226Z 2024-07-04T02:15:00.655733050Z [2024-07-04T02:15:00.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:15:00.656166912Z [2024-07-04T02:15:00.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:15:00.656659471Z [2024-07-04T02:15:00.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:15:00.657031160Z [2024-07-04T02:15:00.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-07-04T02:15:00.657520799Z [2024-07-04T02:15:00.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:15:00.657883103Z [2024-07-04T02:15:00.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:15:00.658412132Z [2024-07-04T02:15:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:15:00.658778649Z [2024-07-04T02:15:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:15:01.235108049Z [2024-07-04T02:15:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status queued for try_number 1 2024-07-04T02:15:01.235340209Z [2024-07-04T02:15:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:14:00+00:00 exited with status queued for try_number 1 2024-07-04T02:15:01.235469561Z [2024-07-04T02:15:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:14:00+00:00 exited with status queued for try_number 1 2024-07-04T02:15:01.235706060Z [2024-07-04T02:15:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:14:00+00:00 exited with status queued for try_number 1 2024-07-04T02:15:01.250620952Z [2024-07-04T02:15:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 240a286f-6d8f-4ec1-9797-2c44c029709e 2024-07-04T02:15:01.251022841Z [2024-07-04T02:15:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7398260b-c761-4fa5-9e2f-4b90ce1cf047 2024-07-04T02:15:01.251238813Z [2024-07-04T02:15:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to e00969d6-fced-4179-bb75-ceb77ac050e7 2024-07-04T02:15:01.251434451Z [2024-07-04T02:15:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57f745fe-f3b4-4f50-9df6-6aab9d670f66 2024-07-04T02:15:02.638797410Z [2024-07-04T02:15:02.638+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:15:02.639689946Z [2024-07-04T02:15:02.639+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf, execution_date=2024-07-04 02:14:00+00:00, run_id=scheduled__2024-07-04T02:14:00+00:00, run_start_date=2024-07-04 02:15:00.555628+00:00, run_end_date=2024-07-04 02:15:02.639186+00:00, run_duration=2.083558, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:14:00+00:00, data_interval_end=2024-07-04 02:15:00+00:00, dag_hash=c534dacb3905b64bd83a2b2d6f5f3b77 2024-07-04T02:15:02.652830013Z [2024-07-04T02:15:02.652+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf to 2024-07-04T02:15:00+00:00, run_after=2024-07-04T02:16:00+00:00 2024-07-04T02:15:03.860770694Z [2024-07-04T02:15:03.860+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:15:03.860812347Z 2024-07-04T02:15:03.860831757Z [2024-07-04T02:15:03.860+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:15:03.861605716Z [2024-07-04T02:15:03.861+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:15:03.861617587Z 2024-07-04T02:15:03.865047858Z [2024-07-04T02:15:03.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:15:03.865086120Z [2024-07-04T02:15:03.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:15:03.973161359Z [2024-07-04T02:15:03.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status queued for try_number 1 2024-07-04T02:15:03.973644290Z [2024-07-04T02:15:03.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status success for try_number 1 2024-07-04T02:15:03.973909205Z [2024-07-04T02:15:03.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:14:00+00:00 exited with status success for try_number 1 2024-07-04T02:15:03.989919698Z [2024-07-04T02:15:03.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3997e62b-53b5-4034-9624-06be90b8fcec 2024-07-04T02:15:03.990234027Z [2024-07-04T02:15:03.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:14:00+00:00, map_index=-1, run_start_date=2024-07-04 02:15:02.010855+00:00, run_end_date=2024-07-04 02:15:02.511270+00:00, run_duration=0.500415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:15:00.651667+00:00, queued_by_job_id=2, pid=4021 2024-07-04T02:15:03.990569674Z [2024-07-04T02:15:03.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:10:00+00:00, map_index=-1, run_start_date=2024-07-04 02:15:03.330916+00:00, run_end_date=2024-07-04 02:15:03.750574+00:00, run_duration=0.419658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:15:00.651667+00:00, queued_by_job_id=2, pid=4062 2024-07-04T02:15:05.110950949Z [2024-07-04T02:15:05.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:15:05.111270320Z [2024-07-04T02:15:05.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:14:00+00:00, run_id=scheduled__2024-07-04T02:14:00+00:00, run_start_date=2024-07-04 02:15:00.553142+00:00, run_end_date=2024-07-04 02:15:05.110764+00:00, run_duration=4.557622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:14:00+00:00, data_interval_end=2024-07-04 02:15:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:15:05.121646283Z [2024-07-04T02:15:05.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:15:00+00:00, run_after=2024-07-04T02:16:00+00:00 2024-07-04T02:15:05.127717998Z [2024-07-04T02:15:05.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:15:05.127876962Z [2024-07-04T02:15:05.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:14:00+00:00, run_id=scheduled__2024-07-04T02:14:00+00:00, run_start_date=2024-07-04 02:15:00.554539+00:00, run_end_date=2024-07-04 02:15:05.127608+00:00, run_duration=4.573069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:14:00+00:00, data_interval_end=2024-07-04 02:15:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:15:05.136173025Z [2024-07-04T02:15:05.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:15:00+00:00, run_after=2024-07-04T02:16:00+00:00 2024-07-04T02:15:05.185976808Z [2024-07-04T02:15:05.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:14:00+00:00 exited with status success for try_number 1 2024-07-04T02:15:05.186389104Z [2024-07-04T02:15:05.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:14:00+00:00 exited with status success for try_number 1 2024-07-04T02:15:05.195685541Z [2024-07-04T02:15:05.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:14:00+00:00, map_index=-1, run_start_date=2024-07-04 02:15:03.121816+00:00, run_end_date=2024-07-04 02:15:04.776432+00:00, run_duration=1.654616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:15:00.651667+00:00, queued_by_job_id=2, pid=4052 2024-07-04T02:15:05.196185351Z [2024-07-04T02:15:05.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:14:00+00:00, map_index=-1, run_start_date=2024-07-04 02:15:03.486582+00:00, run_end_date=2024-07-04 02:15:04.912622+00:00, run_duration=1.42604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:15:00.651667+00:00, queued_by_job_id=2, pid=4072 2024-07-04T02:15:06.467292090Z [2024-07-04T02:15:06.466+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:15:06.467346698Z 2024-07-04T02:15:06.467491472Z [2024-07-04T02:15:06.467+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:15:06.468662206Z [2024-07-04T02:15:06.468+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:15:06.468689760Z 2024-07-04T02:15:06.473531724Z [2024-07-04T02:15:06.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:15:06.474168485Z [2024-07-04T02:15:06.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:15:06.553502594Z [2024-07-04T02:15:06.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status queued for try_number 1 2024-07-04T02:15:06.553921025Z [2024-07-04T02:15:06.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status success for try_number 1 2024-07-04T02:15:06.562722795Z [2024-07-04T02:15:06.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to f34946e3-9fe4-42f0-a014-f86f9a9666e7 2024-07-04T02:15:06.564351217Z [2024-07-04T02:15:06.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:10:00+00:00, map_index=-1, run_start_date=2024-07-04 02:15:05.678962+00:00, run_end_date=2024-07-04 02:15:06.075243+00:00, run_duration=0.396281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:15:03.862115+00:00, queued_by_job_id=2, pid=4101 2024-07-04T02:15:08.873527198Z [2024-07-04T02:15:08.873+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:15:08.873559608Z 2024-07-04T02:15:08.873818287Z [2024-07-04T02:15:08.873+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:15:08.874556395Z [2024-07-04T02:15:08.874+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:15:08.874571029Z 2024-07-04T02:15:08.877465759Z [2024-07-04T02:15:08.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:15:08.877734676Z [2024-07-04T02:15:08.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:15:08.920019699Z [2024-07-04T02:15:08.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status queued for try_number 1 2024-07-04T02:15:08.926565960Z [2024-07-04T02:15:08.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42e65e17-8ceb-45cf-b778-8c6cc7d39bf2 2024-07-04T02:15:08.995159488Z [2024-07-04T02:15:08.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status success for try_number 1 2024-07-04T02:15:09.000443542Z [2024-07-04T02:15:09.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:10:00+00:00, map_index=0, run_start_date=2024-07-04 02:15:08.343552+00:00, run_end_date=2024-07-04 02:15:08.768371+00:00, run_duration=0.424819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:15:06.469246+00:00, queued_by_job_id=2, pid=4113 2024-07-04T02:15:11.954202022Z [2024-07-04T02:15:11.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:15:11.954463322Z [2024-07-04T02:15:11.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:10:00+00:00, run_id=scheduled__2024-07-04T02:10:00+00:00, run_start_date=2024-07-04 02:15:00.551861+00:00, run_end_date=2024-07-04 02:15:11.954016+00:00, run_duration=11.402155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:10:00+00:00, data_interval_end=2024-07-04 02:15:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:15:11.960599373Z [2024-07-04T02:15:11.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:15:00+00:00, run_after=2024-07-04T02:20:00+00:00 2024-07-04T02:15:11.992471283Z [2024-07-04T02:15:11.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:10:00+00:00 exited with status success for try_number 1 2024-07-04T02:15:12.005567652Z [2024-07-04T02:15:12.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:10:00+00:00, map_index=-1, run_start_date=2024-07-04 02:15:10.768452+00:00, run_end_date=2024-07-04 02:15:11.193702+00:00, run_duration=0.42525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:15:08.875117+00:00, queued_by_job_id=2, pid=4125 2024-07-04T02:16:00.477128291Z [2024-07-04T02:16:00.476+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:16:00.497889318Z [2024-07-04T02:16:00.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:16:00+00:00, run_after=2024-07-04T02:17:00+00:00 2024-07-04T02:16:00.520453561Z [2024-07-04T02:16:00.520+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf to 2024-07-04T02:16:00+00:00, run_after=2024-07-04T02:17:00+00:00 2024-07-04T02:16:00.534595206Z [2024-07-04T02:16:00.534+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:16:00.643454413Z [2024-07-04T02:16:00.643+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T02:16:00.643495092Z 2024-07-04T02:16:00.643501118Z 2024-07-04T02:16:00.643523501Z 2024-07-04T02:16:00.643528581Z 2024-07-04T02:16:00.643865649Z [2024-07-04T02:16:00.643+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:16:00.644187478Z [2024-07-04T02:16:00.643+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf has 0/16 running and queued tasks 2024-07-04T02:16:00.644608242Z [2024-07-04T02:16:00.644+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:16:00.644616321Z [2024-07-04T02:16:00.644+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:16:00.645506543Z [2024-07-04T02:16:00.645+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:16:00.645517471Z 2024-07-04T02:16:00.645524026Z 2024-07-04T02:16:00.645529807Z 2024-07-04T02:16:00.645535434Z 2024-07-04T02:16:00.651666403Z [2024-07-04T02:16:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:16:00.651864482Z [2024-07-04T02:16:00.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:16:00.652144421Z [2024-07-04T02:16:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:16:00.652348097Z [2024-07-04T02:16:00.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-07-04T02:16:00.652686216Z [2024-07-04T02:16:00.652+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:16:00.654011788Z [2024-07-04T02:16:00.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:16:00.655326808Z [2024-07-04T02:16:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:16:00.655363925Z [2024-07-04T02:16:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:16:01.219006769Z [2024-07-04T02:16:01.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:14:00+00:00 exited with status queued for try_number 1 2024-07-04T02:16:01.219363867Z [2024-07-04T02:16:01.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status queued for try_number 1 2024-07-04T02:16:01.219604926Z [2024-07-04T02:16:01.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status queued for try_number 1 2024-07-04T02:16:01.219776312Z [2024-07-04T02:16:01.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status queued for try_number 1 2024-07-04T02:16:01.236453814Z [2024-07-04T02:16:01.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to da589eec-ace1-4e9c-b21f-47e96b0dc4f7 2024-07-04T02:16:01.238058834Z [2024-07-04T02:16:01.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to c426cc25-ee1d-4bdd-abf3-e18370ab40b3 2024-07-04T02:16:01.238317976Z [2024-07-04T02:16:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33ba9c02-be0d-4661-9390-15c4429b2885 2024-07-04T02:16:01.238575615Z [2024-07-04T02:16:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 609b9e63-525d-4b72-848a-81fe6c8d7381 2024-07-04T02:16:02.508295186Z [2024-07-04T02:16:02.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:16:02.508552083Z [2024-07-04T02:16:02.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:14:00+00:00, run_id=scheduled__2024-07-04T02:14:00+00:00, run_start_date=2024-07-04 02:16:00.550001+00:00, run_end_date=2024-07-04 02:16:02.508240+00:00, run_duration=1.958239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:14:00+00:00, data_interval_end=2024-07-04 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:16:02.516603939Z [2024-07-04T02:16:02.516+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:16:00+00:00, run_after=2024-07-04T02:18:00+00:00 2024-07-04T02:16:02.578535370Z [2024-07-04T02:16:02.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:14:00+00:00 exited with status success for try_number 1 2024-07-04T02:16:02.580645490Z [2024-07-04T02:16:02.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status failed for try_number 1 2024-07-04T02:16:02.587727382Z [2024-07-04T02:16:02.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:16:00.646733+00:00, queued_by_job_id=2, pid=None 2024-07-04T02:16:02.588180826Z [2024-07-04T02:16:02.587+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:16:02.590397857Z [2024-07-04T02:16:02.590+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:16:02.602439143Z [2024-07-04T02:16:02.602+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240704T021500, start_date=, end_date=20240704T021602 2024-07-04T02:16:02.610343718Z [2024-07-04T02:16:02.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:14:00+00:00, map_index=-1, run_start_date=2024-07-04 02:16:01.788797+00:00, run_end_date=2024-07-04 02:16:02.179458+00:00, run_duration=0.390661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:16:00.646733+00:00, queued_by_job_id=2, pid=4161 2024-07-04T02:16:04.776197614Z [2024-07-04T02:16:04.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:16:04.776224433Z [2024-07-04T02:16:04.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:15:00+00:00, run_id=scheduled__2024-07-04T02:15:00+00:00, run_start_date=2024-07-04 02:16:00.552885+00:00, run_end_date=2024-07-04 02:16:04.773403+00:00, run_duration=4.220518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:15:00+00:00, data_interval_end=2024-07-04 02:16:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:16:04.795059633Z [2024-07-04T02:16:04.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:16:00+00:00, run_after=2024-07-04T02:17:00+00:00 2024-07-04T02:16:04.860465546Z [2024-07-04T02:16:04.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status success for try_number 1 2024-07-04T02:16:04.867071579Z [2024-07-04T02:16:04.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:15:00+00:00, map_index=-1, run_start_date=2024-07-04 02:16:02.728590+00:00, run_end_date=2024-07-04 02:16:04.208237+00:00, run_duration=1.479647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:16:00.646733+00:00, queued_by_job_id=2, pid=4182 2024-07-04T02:16:05.616544341Z [2024-07-04T02:16:05.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:16:05.616657705Z [2024-07-04T02:16:05.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:15:00+00:00, run_id=scheduled__2024-07-04T02:15:00+00:00, run_start_date=2024-07-04 02:16:00.553929+00:00, run_end_date=2024-07-04 02:16:05.616370+00:00, run_duration=5.062441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:15:00+00:00, data_interval_end=2024-07-04 02:16:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:16:05.624808390Z [2024-07-04T02:16:05.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:16:00+00:00, run_after=2024-07-04T02:17:00+00:00 2024-07-04T02:16:05.665598666Z [2024-07-04T02:16:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status success for try_number 1 2024-07-04T02:16:05.671736205Z [2024-07-04T02:16:05.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:15:00+00:00, map_index=-1, run_start_date=2024-07-04 02:16:02.984615+00:00, run_end_date=2024-07-04 02:16:04.808864+00:00, run_duration=1.824249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:16:00.646733+00:00, queued_by_job_id=2, pid=4192 2024-07-04T02:16:13.665199049Z [2024-07-04T02:16:13.664+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:16:13.665242732Z 2024-07-04T02:16:13.665351705Z [2024-07-04T02:16:13.665+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf has 0/16 running and queued tasks 2024-07-04T02:16:13.666381303Z [2024-07-04T02:16:13.666+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:16:13.666397125Z 2024-07-04T02:16:13.670327162Z [2024-07-04T02:16:13.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:15:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:16:13.670743064Z [2024-07-04T02:16:13.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-07-04T02:16:13.741375165Z [2024-07-04T02:16:13.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status queued for try_number 2 2024-07-04T02:16:13.754524716Z [2024-07-04T02:16:13.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f51711d-c8ca-4b7e-9a0c-07676e04fc07 2024-07-04T02:16:14.946244962Z [2024-07-04T02:16:14.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status failed for try_number 2 2024-07-04T02:16:14.955317804Z [2024-07-04T02:16:14.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 02:16:02.592738+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:16:13.667194+00:00, queued_by_job_id=2, pid=None 2024-07-04T02:16:14.955903243Z [2024-07-04T02:16:14.955+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:16:14.958701136Z [2024-07-04T02:16:14.958+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:16:14.979034409Z [2024-07-04T02:16:14.978+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240704T021500, start_date=, end_date=20240704T021614 2024-07-04T02:16:15.748930774Z [2024-07-04T02:16:15.748+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T02:16:15.749388702Z [2024-07-04T02:16:15.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf, execution_date=2024-07-04 02:15:00+00:00, run_id=scheduled__2024-07-04T02:15:00+00:00, run_start_date=2024-07-04 02:16:00.551694+00:00, run_end_date=2024-07-04 02:16:15.748560+00:00, run_duration=15.196866, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:15:00+00:00, data_interval_end=2024-07-04 02:16:00+00:00, dag_hash=c534dacb3905b64bd83a2b2d6f5f3b77 2024-07-04T02:16:15.763124467Z [2024-07-04T02:16:15.762+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf to 2024-07-04T02:16:00+00:00, run_after=2024-07-04T02:17:00+00:00 2024-07-04T02:16:21.588691921Z [2024-07-04T02:16:21.588+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:17:00.206541814Z [2024-07-04T02:17:00.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:17:00+00:00, run_after=2024-07-04T02:18:00+00:00 2024-07-04T02:17:00.214444984Z [2024-07-04T02:17:00.214+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:17:00.289920527Z [2024-07-04T02:17:00.289+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:17:00.289953077Z 2024-07-04T02:17:00.289957051Z 2024-07-04T02:17:00.290029102Z [2024-07-04T02:17:00.289+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:17:00.290203869Z [2024-07-04T02:17:00.290+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:17:00.290910111Z [2024-07-04T02:17:00.290+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:17:00.290917501Z 2024-07-04T02:17:00.290920905Z 2024-07-04T02:17:00.294113814Z [2024-07-04T02:17:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:17:00.294368756Z [2024-07-04T02:17:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:17:00.294680701Z [2024-07-04T02:17:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:17:00.294855437Z [2024-07-04T02:17:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:17:00.519272110Z [2024-07-04T02:17:00.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:16:00+00:00 exited with status queued for try_number 1 2024-07-04T02:17:00.519299184Z [2024-07-04T02:17:00.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:16:00+00:00 exited with status queued for try_number 1 2024-07-04T02:17:00.532356294Z [2024-07-04T02:17:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a6914bd-dbef-4e1b-9555-98b46c7be3b6 2024-07-04T02:17:00.532544833Z [2024-07-04T02:17:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 969807a2-2d2e-4cae-a9ff-5df5d2fa2caf 2024-07-04T02:17:04.317204841Z [2024-07-04T02:17:04.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:17:04.317708321Z [2024-07-04T02:17:04.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:16:00+00:00, run_id=scheduled__2024-07-04T02:16:00+00:00, run_start_date=2024-07-04 02:17:00.230931+00:00, run_end_date=2024-07-04 02:17:04.317199+00:00, run_duration=4.086268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:16:00+00:00, data_interval_end=2024-07-04 02:17:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:17:04.330917063Z [2024-07-04T02:17:04.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:17:00+00:00, run_after=2024-07-04T02:18:00+00:00 2024-07-04T02:17:04.340891251Z [2024-07-04T02:17:04.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:17:04.341134090Z [2024-07-04T02:17:04.340+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:16:00+00:00, run_id=scheduled__2024-07-04T02:16:00+00:00, run_start_date=2024-07-04 02:17:00.232638+00:00, run_end_date=2024-07-04 02:17:04.340857+00:00, run_duration=4.108219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:16:00+00:00, data_interval_end=2024-07-04 02:17:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:17:04.351226189Z [2024-07-04T02:17:04.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:17:00+00:00, run_after=2024-07-04T02:18:00+00:00 2024-07-04T02:17:04.407411133Z [2024-07-04T02:17:04.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:16:00+00:00 exited with status success for try_number 1 2024-07-04T02:17:04.407748898Z [2024-07-04T02:17:04.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:16:00+00:00 exited with status success for try_number 1 2024-07-04T02:17:04.416036919Z [2024-07-04T02:17:04.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:16:00+00:00, map_index=-1, run_start_date=2024-07-04 02:17:02.277803+00:00, run_end_date=2024-07-04 02:17:03.705401+00:00, run_duration=1.427598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:17:00.291680+00:00, queued_by_job_id=2, pid=4262 2024-07-04T02:17:04.416317258Z [2024-07-04T02:17:04.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:16:00+00:00, map_index=-1, run_start_date=2024-07-04 02:17:02.311930+00:00, run_end_date=2024-07-04 02:17:03.922226+00:00, run_duration=1.610296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:17:00.291680+00:00, queued_by_job_id=2, pid=4263 2024-07-04T02:18:00.163787014Z [2024-07-04T02:18:00.163+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:18:00.179965701Z [2024-07-04T02:18:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:18:00+00:00, run_after=2024-07-04T02:19:00+00:00 2024-07-04T02:18:00.191719204Z [2024-07-04T02:18:00.191+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:18:00.305909695Z [2024-07-04T02:18:00.305+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:18:00.305942451Z 2024-07-04T02:18:00.305947388Z 2024-07-04T02:18:00.305951762Z 2024-07-04T02:18:00.306211947Z [2024-07-04T02:18:00.306+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:18:00.306423488Z [2024-07-04T02:18:00.306+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:18:00.306585611Z [2024-07-04T02:18:00.306+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:18:00.307407885Z [2024-07-04T02:18:00.307+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:18:00.307440246Z 2024-07-04T02:18:00.307445038Z 2024-07-04T02:18:00.307448445Z 2024-07-04T02:18:00.310587367Z [2024-07-04T02:18:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:18:00.310761584Z [2024-07-04T02:18:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:18:00.311176476Z [2024-07-04T02:18:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:18:00.311356507Z [2024-07-04T02:18:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:18:00.312123159Z [2024-07-04T02:18:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:18:00.312431429Z [2024-07-04T02:18:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:18:00.908774773Z [2024-07-04T02:18:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:16:00+00:00 exited with status queued for try_number 1 2024-07-04T02:18:00.908998627Z [2024-07-04T02:18:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:17:00+00:00 exited with status queued for try_number 1 2024-07-04T02:18:00.909182184Z [2024-07-04T02:18:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:17:00+00:00 exited with status queued for try_number 1 2024-07-04T02:18:00.930037761Z [2024-07-04T02:18:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to b89a2d0c-0ba9-4b0b-8c18-42dd7f5d45f5 2024-07-04T02:18:00.930372621Z [2024-07-04T02:18:00.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7249162-b2bb-4aa0-95c4-87904c029592 2024-07-04T02:18:00.930592765Z [2024-07-04T02:18:00.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to 485c6aea-db5a-4150-baa3-83ddf7e6b19b 2024-07-04T02:18:03.147892806Z [2024-07-04T02:18:03.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:18:03.148870961Z [2024-07-04T02:18:03.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:16:00+00:00, run_id=scheduled__2024-07-04T02:16:00+00:00, run_start_date=2024-07-04 02:18:00.204646+00:00, run_end_date=2024-07-04 02:18:03.148004+00:00, run_duration=2.943358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:16:00+00:00, data_interval_end=2024-07-04 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:18:03.162304076Z [2024-07-04T02:18:03.162+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:18:00+00:00, run_after=2024-07-04T02:20:00+00:00 2024-07-04T02:18:03.280824221Z [2024-07-04T02:18:03.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:16:00+00:00 exited with status success for try_number 1 2024-07-04T02:18:03.310161672Z [2024-07-04T02:18:03.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:16:00+00:00, map_index=-1, run_start_date=2024-07-04 02:18:01.960643+00:00, run_end_date=2024-07-04 02:18:02.662158+00:00, run_duration=0.701515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:18:00.308079+00:00, queued_by_job_id=2, pid=4300 2024-07-04T02:18:05.520858563Z [2024-07-04T02:18:05.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:18:05.521469641Z [2024-07-04T02:18:05.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:17:00+00:00, run_id=scheduled__2024-07-04T02:17:00+00:00, run_start_date=2024-07-04 02:18:00.206196+00:00, run_end_date=2024-07-04 02:18:05.520678+00:00, run_duration=5.314482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:17:00+00:00, data_interval_end=2024-07-04 02:18:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:18:05.533650008Z [2024-07-04T02:18:05.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:18:00+00:00, run_after=2024-07-04T02:19:00+00:00 2024-07-04T02:18:05.541727163Z [2024-07-04T02:18:05.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:18:05.542311525Z [2024-07-04T02:18:05.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:17:00+00:00, run_id=scheduled__2024-07-04T02:17:00+00:00, run_start_date=2024-07-04 02:18:00.207372+00:00, run_end_date=2024-07-04 02:18:05.541604+00:00, run_duration=5.334232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:17:00+00:00, data_interval_end=2024-07-04 02:18:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:18:05.552986381Z [2024-07-04T02:18:05.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:18:00+00:00, run_after=2024-07-04T02:19:00+00:00 2024-07-04T02:18:05.605188599Z [2024-07-04T02:18:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:17:00+00:00 exited with status success for try_number 1 2024-07-04T02:18:05.605471180Z [2024-07-04T02:18:05.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:17:00+00:00 exited with status success for try_number 1 2024-07-04T02:18:05.614998509Z [2024-07-04T02:18:05.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:17:00+00:00, map_index=-1, run_start_date=2024-07-04 02:18:03.018006+00:00, run_end_date=2024-07-04 02:18:04.532866+00:00, run_duration=1.51486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:18:00.308079+00:00, queued_by_job_id=2, pid=4328 2024-07-04T02:18:05.615484815Z [2024-07-04T02:18:05.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:17:00+00:00, map_index=-1, run_start_date=2024-07-04 02:18:03.212742+00:00, run_end_date=2024-07-04 02:18:05.147923+00:00, run_duration=1.935181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:18:00.308079+00:00, queued_by_job_id=2, pid=4329 2024-07-04T02:19:00.251001929Z [2024-07-04T02:19:00.250+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:19:00.270411343Z [2024-07-04T02:19:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:19:00+00:00, run_after=2024-07-04T02:20:00+00:00 2024-07-04T02:19:00.381021147Z [2024-07-04T02:19:00.380+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:19:00.381057998Z 2024-07-04T02:19:00.381062049Z 2024-07-04T02:19:00.387915979Z [2024-07-04T02:19:00.387+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:19:00.391800309Z [2024-07-04T02:19:00.391+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:19:00.393370800Z [2024-07-04T02:19:00.393+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:19:00.393392055Z 2024-07-04T02:19:00.393397826Z 2024-07-04T02:19:00.403446813Z [2024-07-04T02:19:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:19:00.403895667Z [2024-07-04T02:19:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:19:00.404462987Z [2024-07-04T02:19:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:19:00.404754006Z [2024-07-04T02:19:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:19:00.694900697Z [2024-07-04T02:19:00.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:18:00+00:00 exited with status queued for try_number 1 2024-07-04T02:19:00.696395537Z [2024-07-04T02:19:00.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:18:00+00:00 exited with status queued for try_number 1 2024-07-04T02:19:00.711313768Z [2024-07-04T02:19:00.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to abb775bb-2a35-4cf9-b4f5-c93700bbe8f7 2024-07-04T02:19:00.711540002Z [2024-07-04T02:19:00.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34a4efcb-986c-46f1-a7b1-43bcd005b5ee 2024-07-04T02:19:04.147284547Z [2024-07-04T02:19:04.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:19:04.147764860Z [2024-07-04T02:19:04.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:18:00+00:00, run_id=scheduled__2024-07-04T02:18:00+00:00, run_start_date=2024-07-04 02:19:00.288250+00:00, run_end_date=2024-07-04 02:19:04.147354+00:00, run_duration=3.859104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:18:00+00:00, data_interval_end=2024-07-04 02:19:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:19:04.159083768Z [2024-07-04T02:19:04.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:19:00+00:00, run_after=2024-07-04T02:20:00+00:00 2024-07-04T02:19:04.224737366Z [2024-07-04T02:19:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:18:00+00:00 exited with status success for try_number 1 2024-07-04T02:19:04.235807694Z [2024-07-04T02:19:04.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:18:00+00:00, map_index=-1, run_start_date=2024-07-04 02:19:02.576648+00:00, run_end_date=2024-07-04 02:19:03.985316+00:00, run_duration=1.408668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:19:00.394548+00:00, queued_by_job_id=2, pid=4383 2024-07-04T02:19:05.306256734Z [2024-07-04T02:19:05.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:19:05.306574521Z [2024-07-04T02:19:05.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:18:00+00:00, run_id=scheduled__2024-07-04T02:18:00+00:00, run_start_date=2024-07-04 02:19:00.290562+00:00, run_end_date=2024-07-04 02:19:05.306226+00:00, run_duration=5.015664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:18:00+00:00, data_interval_end=2024-07-04 02:19:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:19:05.320463811Z [2024-07-04T02:19:05.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:19:00+00:00, run_after=2024-07-04T02:20:00+00:00 2024-07-04T02:19:05.365670287Z [2024-07-04T02:19:05.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:18:00+00:00 exited with status success for try_number 1 2024-07-04T02:19:05.372667534Z [2024-07-04T02:19:05.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:18:00+00:00, map_index=-1, run_start_date=2024-07-04 02:19:02.596162+00:00, run_end_date=2024-07-04 02:19:04.598450+00:00, run_duration=2.002288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:19:00.394548+00:00, queued_by_job_id=2, pid=4384 2024-07-04T02:20:00.177448816Z [2024-07-04T02:20:00.176+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:20:00.199902198Z [2024-07-04T02:20:00.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:20:00+00:00, run_after=2024-07-04T02:25:00+00:00 2024-07-04T02:20:00.210628317Z [2024-07-04T02:20:00.210+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:20:00.230357192Z [2024-07-04T02:20:00.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:20:00+00:00, run_after=2024-07-04T02:21:00+00:00 2024-07-04T02:20:00.344271224Z [2024-07-04T02:20:00.343+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T02:20:00.344319246Z 2024-07-04T02:20:00.344329066Z 2024-07-04T02:20:00.344338936Z 2024-07-04T02:20:00.344356738Z 2024-07-04T02:20:00.344838001Z [2024-07-04T02:20:00.344+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:20:00.345058626Z [2024-07-04T02:20:00.344+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:20:00.345272559Z [2024-07-04T02:20:00.345+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:20:00.345622696Z [2024-07-04T02:20:00.345+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:20:00.347451750Z [2024-07-04T02:20:00.346+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:20:00.347473756Z 2024-07-04T02:20:00.347479523Z 2024-07-04T02:20:00.347485303Z 2024-07-04T02:20:00.347489889Z 2024-07-04T02:20:00.356096945Z [2024-07-04T02:20:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:20:00.356433427Z [2024-07-04T02:20:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:20:00.356974456Z [2024-07-04T02:20:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:20:00.357161988Z [2024-07-04T02:20:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:20:00.357495763Z [2024-07-04T02:20:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:20:00.357655077Z [2024-07-04T02:20:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:20:00.358111543Z [2024-07-04T02:20:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:20:00.358270124Z [2024-07-04T02:20:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:20:00.969495371Z [2024-07-04T02:20:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status queued for try_number 1 2024-07-04T02:20:00.971763531Z [2024-07-04T02:20:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:18:00+00:00 exited with status queued for try_number 1 2024-07-04T02:20:00.972056041Z [2024-07-04T02:20:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:19:00+00:00 exited with status queued for try_number 1 2024-07-04T02:20:00.972264429Z [2024-07-04T02:20:00.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:19:00+00:00 exited with status queued for try_number 1 2024-07-04T02:20:00.992236776Z [2024-07-04T02:20:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9200c266-a9c3-438e-aad8-46495bc8f560 2024-07-04T02:20:00.994506707Z [2024-07-04T02:20:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c1b9c43-5785-4a9d-9087-9a419e156c79 2024-07-04T02:20:00.995241786Z [2024-07-04T02:20:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to fab13301-0321-44db-a1dd-75269531935e 2024-07-04T02:20:00.995537098Z [2024-07-04T02:20:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b2de557-9988-469a-88c8-bc86304b61d1 2024-07-04T02:20:02.302249899Z [2024-07-04T02:20:02.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:20:02.302455034Z [2024-07-04T02:20:02.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:18:00+00:00, run_id=scheduled__2024-07-04T02:18:00+00:00, run_start_date=2024-07-04 02:20:00.245698+00:00, run_end_date=2024-07-04 02:20:02.302162+00:00, run_duration=2.056464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:18:00+00:00, data_interval_end=2024-07-04 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:20:02.312235449Z [2024-07-04T02:20:02.311+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:20:00+00:00, run_after=2024-07-04T02:22:00+00:00 2024-07-04T02:20:03.461960715Z [2024-07-04T02:20:03.461+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:20:03.461999037Z 2024-07-04T02:20:03.462025367Z [2024-07-04T02:20:03.461+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:20:03.462691632Z [2024-07-04T02:20:03.462+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:20:03.462710905Z 2024-07-04T02:20:03.465515539Z [2024-07-04T02:20:03.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:20:03.465728719Z [2024-07-04T02:20:03.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:20:03.544718805Z [2024-07-04T02:20:03.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status queued for try_number 1 2024-07-04T02:20:03.545054993Z [2024-07-04T02:20:03.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status success for try_number 1 2024-07-04T02:20:03.545234120Z [2024-07-04T02:20:03.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:18:00+00:00 exited with status success for try_number 1 2024-07-04T02:20:03.555135149Z [2024-07-04T02:20:03.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:15:00+00:00, map_index=-1, run_start_date=2024-07-04 02:20:02.833663+00:00, run_end_date=2024-07-04 02:20:03.276963+00:00, run_duration=0.4433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:20:00.350158+00:00, queued_by_job_id=2, pid=4460 2024-07-04T02:20:03.555282664Z [2024-07-04T02:20:03.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e372f24-2575-4606-96be-2fc4dbf14dfc 2024-07-04T02:20:03.555531449Z [2024-07-04T02:20:03.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:18:00+00:00, map_index=-1, run_start_date=2024-07-04 02:20:01.732384+00:00, run_end_date=2024-07-04 02:20:02.271083+00:00, run_duration=0.538699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:20:00.350158+00:00, queued_by_job_id=2, pid=4420 2024-07-04T02:20:04.696124475Z [2024-07-04T02:20:04.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:20:04.696343243Z [2024-07-04T02:20:04.696+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:19:00+00:00, run_id=scheduled__2024-07-04T02:19:00+00:00, run_start_date=2024-07-04 02:20:00.246894+00:00, run_end_date=2024-07-04 02:20:04.696022+00:00, run_duration=4.449128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:19:00+00:00, data_interval_end=2024-07-04 02:20:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:20:04.707000600Z [2024-07-04T02:20:04.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:20:00+00:00, run_after=2024-07-04T02:21:00+00:00 2024-07-04T02:20:04.728195871Z [2024-07-04T02:20:04.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:20:04.728225427Z [2024-07-04T02:20:04.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:19:00+00:00, run_id=scheduled__2024-07-04T02:19:00+00:00, run_start_date=2024-07-04 02:20:00.248263+00:00, run_end_date=2024-07-04 02:20:04.716774+00:00, run_duration=4.468511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:19:00+00:00, data_interval_end=2024-07-04 02:20:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:20:04.728230600Z [2024-07-04T02:20:04.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:20:00+00:00, run_after=2024-07-04T02:21:00+00:00 2024-07-04T02:20:04.848684521Z [2024-07-04T02:20:04.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:19:00+00:00 exited with status success for try_number 1 2024-07-04T02:20:04.857956589Z [2024-07-04T02:20:04.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:19:00+00:00, map_index=-1, run_start_date=2024-07-04 02:20:02.997109+00:00, run_end_date=2024-07-04 02:20:04.291951+00:00, run_duration=1.294842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:20:00.350158+00:00, queued_by_job_id=2, pid=4462 2024-07-04T02:20:05.944247500Z [2024-07-04T02:20:05.943+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:20:05.944297681Z 2024-07-04T02:20:05.944548190Z [2024-07-04T02:20:05.944+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:20:05.945221150Z [2024-07-04T02:20:05.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:20:05.945257772Z 2024-07-04T02:20:05.947765698Z [2024-07-04T02:20:05.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:20:05.948007643Z [2024-07-04T02:20:05.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:20:06.024218833Z [2024-07-04T02:20:06.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status queued for try_number 1 2024-07-04T02:20:06.024505443Z [2024-07-04T02:20:06.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:19:00+00:00 exited with status success for try_number 1 2024-07-04T02:20:06.024647080Z [2024-07-04T02:20:06.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status success for try_number 1 2024-07-04T02:20:06.037174609Z [2024-07-04T02:20:06.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:19:00+00:00, map_index=-1, run_start_date=2024-07-04 02:20:02.833588+00:00, run_end_date=2024-07-04 02:20:04.666766+00:00, run_duration=1.833178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:20:00.350158+00:00, queued_by_job_id=2, pid=4461 2024-07-04T02:20:06.037428213Z [2024-07-04T02:20:06.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:15:00+00:00, map_index=-1, run_start_date=2024-07-04 02:20:05.282264+00:00, run_end_date=2024-07-04 02:20:05.628517+00:00, run_duration=0.346253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:20:03.463175+00:00, queued_by_job_id=2, pid=4500 2024-07-04T02:20:06.037744275Z [2024-07-04T02:20:06.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to df966d60-268b-4342-afa8-4071c36518e4 2024-07-04T02:20:08.447548191Z [2024-07-04T02:20:08.447+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:20:08.447579102Z 2024-07-04T02:20:08.447583766Z [2024-07-04T02:20:08.447+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:20:08.448283765Z [2024-07-04T02:20:08.448+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:20:08.448297148Z 2024-07-04T02:20:08.450483799Z [2024-07-04T02:20:08.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:20:08.450760763Z [2024-07-04T02:20:08.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:20:08.518711629Z [2024-07-04T02:20:08.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status queued for try_number 1 2024-07-04T02:20:08.521087540Z [2024-07-04T02:20:08.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status success for try_number 1 2024-07-04T02:20:08.527048986Z [2024-07-04T02:20:08.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64a409a1-2b2f-41b2-8425-4b54e76c8b23 2024-07-04T02:20:08.527375808Z [2024-07-04T02:20:08.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:15:00+00:00, map_index=0, run_start_date=2024-07-04 02:20:07.673812+00:00, run_end_date=2024-07-04 02:20:08.085154+00:00, run_duration=0.411342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:20:05.945587+00:00, queued_by_job_id=2, pid=4512 2024-07-04T02:20:10.826403855Z [2024-07-04T02:20:10.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:20:10.826722924Z [2024-07-04T02:20:10.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:15:00+00:00, run_id=scheduled__2024-07-04T02:15:00+00:00, run_start_date=2024-07-04 02:20:00.244130+00:00, run_end_date=2024-07-04 02:20:10.826410+00:00, run_duration=10.58228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:15:00+00:00, data_interval_end=2024-07-04 02:20:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:20:10.837483646Z [2024-07-04T02:20:10.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:20:00+00:00, run_after=2024-07-04T02:25:00+00:00 2024-07-04T02:20:10.899427423Z [2024-07-04T02:20:10.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:15:00+00:00 exited with status success for try_number 1 2024-07-04T02:20:10.907738109Z [2024-07-04T02:20:10.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:15:00+00:00, map_index=-1, run_start_date=2024-07-04 02:20:10.162795+00:00, run_end_date=2024-07-04 02:20:10.705763+00:00, run_duration=0.542968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:20:08.448649+00:00, queued_by_job_id=2, pid=4524 2024-07-04T02:21:00.911530489Z [2024-07-04T02:21:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:21:00+00:00, run_after=2024-07-04T02:22:00+00:00 2024-07-04T02:21:00.927222815Z [2024-07-04T02:21:00.926+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:21:01.006567095Z [2024-07-04T02:21:01.005+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:21:01.006621408Z 2024-07-04T02:21:01.006632187Z 2024-07-04T02:21:01.006641476Z [2024-07-04T02:21:01.006+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:21:01.006650205Z [2024-07-04T02:21:01.006+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:21:01.007685302Z [2024-07-04T02:21:01.007+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:21:01.007714179Z 2024-07-04T02:21:01.007723983Z 2024-07-04T02:21:01.011538578Z [2024-07-04T02:21:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:21:01.011565316Z [2024-07-04T02:21:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:21:01.011918413Z [2024-07-04T02:21:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:21:01.012247875Z [2024-07-04T02:21:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:21:01.198489394Z [2024-07-04T02:21:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status queued for try_number 1 2024-07-04T02:21:01.198739065Z [2024-07-04T02:21:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status queued for try_number 1 2024-07-04T02:21:01.207005461Z [2024-07-04T02:21:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b5bf152-92db-4df0-9886-7c55d989487b 2024-07-04T02:21:01.207157805Z [2024-07-04T02:21:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49e835ce-293f-4324-81a3-f65ec65423be 2024-07-04T02:21:05.309677082Z [2024-07-04T02:21:05.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:21:05.310779525Z [2024-07-04T02:21:05.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:20:00+00:00, run_id=scheduled__2024-07-04T02:20:00+00:00, run_start_date=2024-07-04 02:21:00.943455+00:00, run_end_date=2024-07-04 02:21:05.309462+00:00, run_duration=4.366007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:20:00+00:00, data_interval_end=2024-07-04 02:21:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:21:05.325258217Z [2024-07-04T02:21:05.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:21:00+00:00, run_after=2024-07-04T02:22:00+00:00 2024-07-04T02:21:05.379763361Z [2024-07-04T02:21:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status success for try_number 1 2024-07-04T02:21:05.389592051Z [2024-07-04T02:21:05.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:20:00+00:00, map_index=-1, run_start_date=2024-07-04 02:21:02.854433+00:00, run_end_date=2024-07-04 02:21:04.893613+00:00, run_duration=2.03918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:21:01.008426+00:00, queued_by_job_id=2, pid=4561 2024-07-04T02:21:07.003360427Z [2024-07-04T02:21:07.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:21:07.003431523Z [2024-07-04T02:21:07.000+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:20:00+00:00, run_id=scheduled__2024-07-04T02:20:00+00:00, run_start_date=2024-07-04 02:21:00.945269+00:00, run_end_date=2024-07-04 02:21:07.000742+00:00, run_duration=6.055473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:20:00+00:00, data_interval_end=2024-07-04 02:21:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:21:07.014768989Z [2024-07-04T02:21:07.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:21:00+00:00, run_after=2024-07-04T02:22:00+00:00 2024-07-04T02:21:07.057336435Z [2024-07-04T02:21:07.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status success for try_number 1 2024-07-04T02:21:07.065266125Z [2024-07-04T02:21:07.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:20:00+00:00, map_index=-1, run_start_date=2024-07-04 02:21:03.044636+00:00, run_end_date=2024-07-04 02:21:06.417570+00:00, run_duration=3.372934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:21:01.008426+00:00, queued_by_job_id=2, pid=4562 2024-07-04T02:21:21.655810163Z [2024-07-04T02:21:21.653+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:22:00.298508518Z [2024-07-04T02:22:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:22:00+00:00, run_after=2024-07-04T02:23:00+00:00 2024-07-04T02:22:00.310519685Z [2024-07-04T02:22:00.310+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:22:00.319542838Z [2024-07-04T02:22:00.319+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:22:00.420759669Z [2024-07-04T02:22:00.420+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:22:00.420786521Z 2024-07-04T02:22:00.420792006Z 2024-07-04T02:22:00.420796831Z 2024-07-04T02:22:00.420870177Z [2024-07-04T02:22:00.420+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:22:00.421032712Z [2024-07-04T02:22:00.420+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:22:00.421317877Z [2024-07-04T02:22:00.421+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:22:00.422171744Z [2024-07-04T02:22:00.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:22:00.422215941Z 2024-07-04T02:22:00.422221231Z 2024-07-04T02:22:00.422226085Z 2024-07-04T02:22:00.427605028Z [2024-07-04T02:22:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:22:00.427904708Z [2024-07-04T02:22:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:22:00.428540712Z [2024-07-04T02:22:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:22:00.428553422Z [2024-07-04T02:22:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:22:00.429141326Z [2024-07-04T02:22:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:22:00.429307214Z [2024-07-04T02:22:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:22:00.782548537Z [2024-07-04T02:22:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status queued for try_number 1 2024-07-04T02:22:00.784920741Z [2024-07-04T02:22:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:21:00+00:00 exited with status queued for try_number 1 2024-07-04T02:22:00.785145030Z [2024-07-04T02:22:00.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:21:00+00:00 exited with status queued for try_number 1 2024-07-04T02:22:00.795881482Z [2024-07-04T02:22:00.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45a4461d-4639-4858-a296-e458a020da14 2024-07-04T02:22:00.796109765Z [2024-07-04T02:22:00.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to aabbcb65-814c-4d6a-a62d-d666313cd9e3 2024-07-04T02:22:00.796283590Z [2024-07-04T02:22:00.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1de0cb13-857c-49ca-b407-b9bb8e08e576 2024-07-04T02:22:02.942956228Z [2024-07-04T02:22:02.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:22:02.943493966Z [2024-07-04T02:22:02.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:20:00+00:00, run_id=scheduled__2024-07-04T02:20:00+00:00, run_start_date=2024-07-04 02:22:00.335260+00:00, run_end_date=2024-07-04 02:22:02.943056+00:00, run_duration=2.607796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:20:00+00:00, data_interval_end=2024-07-04 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:22:02.956388437Z [2024-07-04T02:22:02.956+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:22:00+00:00, run_after=2024-07-04T02:24:00+00:00 2024-07-04T02:22:03.036169191Z [2024-07-04T02:22:03.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status success for try_number 1 2024-07-04T02:22:03.042050663Z [2024-07-04T02:22:03.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:20:00+00:00, map_index=-1, run_start_date=2024-07-04 02:22:01.717994+00:00, run_end_date=2024-07-04 02:22:02.095410+00:00, run_duration=0.377416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:22:00.423510+00:00, queued_by_job_id=2, pid=4598 2024-07-04T02:22:04.111003153Z [2024-07-04T02:22:04.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:22:04.111229322Z [2024-07-04T02:22:04.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:21:00+00:00, run_id=scheduled__2024-07-04T02:21:00+00:00, run_start_date=2024-07-04 02:22:00.337192+00:00, run_end_date=2024-07-04 02:22:04.110942+00:00, run_duration=3.77375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:21:00+00:00, data_interval_end=2024-07-04 02:22:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:22:04.121376707Z [2024-07-04T02:22:04.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:22:00+00:00, run_after=2024-07-04T02:23:00+00:00 2024-07-04T02:22:04.154574896Z [2024-07-04T02:22:04.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:21:00+00:00 exited with status success for try_number 1 2024-07-04T02:22:04.161206321Z [2024-07-04T02:22:04.160+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:21:00+00:00, map_index=-1, run_start_date=2024-07-04 02:22:02.520151+00:00, run_end_date=2024-07-04 02:22:03.874834+00:00, run_duration=1.354683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:22:00.423510+00:00, queued_by_job_id=2, pid=4618 2024-07-04T02:22:06.309833887Z [2024-07-04T02:22:06.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:22:06.310298418Z [2024-07-04T02:22:06.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:21:00+00:00, run_id=scheduled__2024-07-04T02:21:00+00:00, run_start_date=2024-07-04 02:22:00.338707+00:00, run_end_date=2024-07-04 02:22:06.309682+00:00, run_duration=5.970975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:21:00+00:00, data_interval_end=2024-07-04 02:22:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:22:06.321155496Z [2024-07-04T02:22:06.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:22:00+00:00, run_after=2024-07-04T02:23:00+00:00 2024-07-04T02:22:07.370589836Z [2024-07-04T02:22:07.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:21:00+00:00 exited with status success for try_number 1 2024-07-04T02:22:07.379993082Z [2024-07-04T02:22:07.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:21:00+00:00, map_index=-1, run_start_date=2024-07-04 02:22:02.859817+00:00, run_end_date=2024-07-04 02:22:06.262286+00:00, run_duration=3.402469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:22:00.423510+00:00, queued_by_job_id=2, pid=4637 2024-07-04T02:23:01.082114219Z [2024-07-04T02:23:01.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:23:00+00:00, run_after=2024-07-04T02:24:00+00:00 2024-07-04T02:23:01.096995740Z [2024-07-04T02:23:01.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:23:01.163786214Z [2024-07-04T02:23:01.163+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:23:01.163821965Z 2024-07-04T02:23:01.163827017Z 2024-07-04T02:23:01.163975692Z [2024-07-04T02:23:01.163+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:23:01.164155692Z [2024-07-04T02:23:01.164+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:23:01.164885693Z [2024-07-04T02:23:01.164+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:23:01.164899474Z 2024-07-04T02:23:01.164903395Z 2024-07-04T02:23:01.169854854Z [2024-07-04T02:23:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:23:01.170370387Z [2024-07-04T02:23:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:23:01.171549048Z [2024-07-04T02:23:01.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:23:01.171761457Z [2024-07-04T02:23:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:23:01.374964310Z [2024-07-04T02:23:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:22:00+00:00 exited with status queued for try_number 1 2024-07-04T02:23:01.375095725Z [2024-07-04T02:23:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:22:00+00:00 exited with status queued for try_number 1 2024-07-04T02:23:01.385679888Z [2024-07-04T02:23:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4e46d05-dba9-4f19-89be-7066d2789d44 2024-07-04T02:23:01.385791652Z [2024-07-04T02:23:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to 729265d8-d04f-49c1-8cc9-e3c1e2a5f214 2024-07-04T02:23:06.222730731Z [2024-07-04T02:23:06.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:23:06.223108739Z [2024-07-04T02:23:06.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:22:00+00:00, run_id=scheduled__2024-07-04T02:22:00+00:00, run_start_date=2024-07-04 02:23:01.112493+00:00, run_end_date=2024-07-04 02:23:06.222560+00:00, run_duration=5.110067, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:22:00+00:00, data_interval_end=2024-07-04 02:23:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:23:06.237459167Z [2024-07-04T02:23:06.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:23:00+00:00, run_after=2024-07-04T02:24:00+00:00 2024-07-04T02:23:06.245653420Z [2024-07-04T02:23:06.245+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:23:06.245809214Z [2024-07-04T02:23:06.245+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:22:00+00:00, run_id=scheduled__2024-07-04T02:22:00+00:00, run_start_date=2024-07-04 02:23:01.114298+00:00, run_end_date=2024-07-04 02:23:06.245564+00:00, run_duration=5.131266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:22:00+00:00, data_interval_end=2024-07-04 02:23:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:23:06.255317967Z [2024-07-04T02:23:06.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:23:00+00:00, run_after=2024-07-04T02:24:00+00:00 2024-07-04T02:23:06.300047262Z [2024-07-04T02:23:06.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:22:00+00:00 exited with status success for try_number 1 2024-07-04T02:23:06.300216440Z [2024-07-04T02:23:06.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:22:00+00:00 exited with status success for try_number 1 2024-07-04T02:23:06.309588019Z [2024-07-04T02:23:06.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:22:00+00:00, map_index=-1, run_start_date=2024-07-04 02:23:03.320214+00:00, run_end_date=2024-07-04 02:23:05.228531+00:00, run_duration=1.908317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:23:01.165604+00:00, queued_by_job_id=2, pid=4683 2024-07-04T02:23:06.309862257Z [2024-07-04T02:23:06.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:22:00+00:00, map_index=-1, run_start_date=2024-07-04 02:23:03.380697+00:00, run_end_date=2024-07-04 02:23:05.960946+00:00, run_duration=2.580249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:23:01.165604+00:00, queued_by_job_id=2, pid=4684 2024-07-04T02:24:00.030233619Z [2024-07-04T02:24:00.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:24:00+00:00, run_after=2024-07-04T02:25:00+00:00 2024-07-04T02:24:00.037440211Z [2024-07-04T02:24:00.037+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:24:00.051368067Z [2024-07-04T02:24:00.051+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:24:00.121294386Z [2024-07-04T02:24:00.120+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:24:00.121336761Z 2024-07-04T02:24:00.121350096Z 2024-07-04T02:24:00.121359094Z 2024-07-04T02:24:00.121370732Z [2024-07-04T02:24:00.121+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:24:00.121423025Z [2024-07-04T02:24:00.121+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:24:00.121432799Z [2024-07-04T02:24:00.121+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:24:00.122010336Z [2024-07-04T02:24:00.121+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:24:00.122026153Z 2024-07-04T02:24:00.122035632Z 2024-07-04T02:24:00.122044396Z 2024-07-04T02:24:00.125244799Z [2024-07-04T02:24:00.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:24:00.125291432Z [2024-07-04T02:24:00.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:24:00.125513908Z [2024-07-04T02:24:00.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:24:00.125540384Z [2024-07-04T02:24:00.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:24:00.125742103Z [2024-07-04T02:24:00.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:24:00.125767670Z [2024-07-04T02:24:00.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:24:00.627238570Z [2024-07-04T02:24:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:22:00+00:00 exited with status queued for try_number 1 2024-07-04T02:24:00.629062412Z [2024-07-04T02:24:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:23:00+00:00 exited with status queued for try_number 1 2024-07-04T02:24:00.633873334Z [2024-07-04T02:24:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:23:00+00:00 exited with status queued for try_number 1 2024-07-04T02:24:00.669123344Z [2024-07-04T02:24:00.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5598d2ee-19a6-4bd5-a8dc-43bf405f88ab 2024-07-04T02:24:00.669306351Z [2024-07-04T02:24:00.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to edbba634-5806-477e-898b-8852d3251c0c 2024-07-04T02:24:00.669494266Z [2024-07-04T02:24:00.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9ff6d65-aebc-4746-81a7-3f59e5484f15 2024-07-04T02:24:02.050061352Z [2024-07-04T02:24:02.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:24:02.050273701Z [2024-07-04T02:24:02.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:22:00+00:00, run_id=scheduled__2024-07-04T02:22:00+00:00, run_start_date=2024-07-04 02:24:00.067196+00:00, run_end_date=2024-07-04 02:24:02.049953+00:00, run_duration=1.982757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:22:00+00:00, data_interval_end=2024-07-04 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:24:02.057609662Z [2024-07-04T02:24:02.057+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:24:00+00:00, run_after=2024-07-04T02:26:00+00:00 2024-07-04T02:24:02.111629290Z [2024-07-04T02:24:02.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:22:00+00:00 exited with status success for try_number 1 2024-07-04T02:24:02.129453657Z [2024-07-04T02:24:02.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:22:00+00:00, map_index=-1, run_start_date=2024-07-04 02:24:01.467045+00:00, run_end_date=2024-07-04 02:24:01.928816+00:00, run_duration=0.461771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:24:00.122622+00:00, queued_by_job_id=2, pid=4719 2024-07-04T02:24:04.328421868Z [2024-07-04T02:24:04.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:24:04.328696586Z [2024-07-04T02:24:04.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:23:00+00:00, run_id=scheduled__2024-07-04T02:23:00+00:00, run_start_date=2024-07-04 02:24:00.071204+00:00, run_end_date=2024-07-04 02:24:04.328240+00:00, run_duration=4.257036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:23:00+00:00, data_interval_end=2024-07-04 02:24:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:24:04.339993479Z [2024-07-04T02:24:04.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:24:00+00:00, run_after=2024-07-04T02:25:00+00:00 2024-07-04T02:24:04.383815739Z [2024-07-04T02:24:04.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:23:00+00:00 exited with status success for try_number 1 2024-07-04T02:24:04.390680329Z [2024-07-04T02:24:04.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:23:00+00:00, map_index=-1, run_start_date=2024-07-04 02:24:02.599727+00:00, run_end_date=2024-07-04 02:24:04.036222+00:00, run_duration=1.436495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:24:00.122622+00:00, queued_by_job_id=2, pid=4749 2024-07-04T02:24:05.457377367Z [2024-07-04T02:24:05.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:24:05.457984702Z [2024-07-04T02:24:05.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:23:00+00:00, run_id=scheduled__2024-07-04T02:23:00+00:00, run_start_date=2024-07-04 02:24:00.073216+00:00, run_end_date=2024-07-04 02:24:05.457210+00:00, run_duration=5.383994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:23:00+00:00, data_interval_end=2024-07-04 02:24:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:24:05.487926776Z [2024-07-04T02:24:05.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:24:00+00:00, run_after=2024-07-04T02:25:00+00:00 2024-07-04T02:24:05.535764472Z [2024-07-04T02:24:05.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:23:00+00:00 exited with status success for try_number 1 2024-07-04T02:24:05.543337897Z [2024-07-04T02:24:05.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:23:00+00:00, map_index=-1, run_start_date=2024-07-04 02:24:02.656248+00:00, run_end_date=2024-07-04 02:24:04.514639+00:00, run_duration=1.858391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:24:00.122622+00:00, queued_by_job_id=2, pid=4750 2024-07-04T02:25:00.458748266Z [2024-07-04T02:25:00.458+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:25:00.480982350Z [2024-07-04T02:25:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:25:00+00:00, run_after=2024-07-04T02:26:00+00:00 2024-07-04T02:25:00.517648898Z [2024-07-04T02:25:00.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:25:00+00:00, run_after=2024-07-04T02:30:00+00:00 2024-07-04T02:25:00.648979119Z [2024-07-04T02:25:00.648+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:25:00.649004212Z 2024-07-04T02:25:00.649008689Z 2024-07-04T02:25:00.649011820Z 2024-07-04T02:25:00.649170921Z [2024-07-04T02:25:00.648+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:25:00.649361768Z [2024-07-04T02:25:00.649+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:25:00.649513888Z [2024-07-04T02:25:00.649+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:25:00.650198737Z [2024-07-04T02:25:00.649+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:25:00.650210450Z 2024-07-04T02:25:00.650214109Z 2024-07-04T02:25:00.650217148Z 2024-07-04T02:25:00.653871073Z [2024-07-04T02:25:00.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:25:00.654135454Z [2024-07-04T02:25:00.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:25:00.654409626Z [2024-07-04T02:25:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:25:00.654585941Z [2024-07-04T02:25:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:25:00.664488495Z [2024-07-04T02:25:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:25:00.664868378Z [2024-07-04T02:25:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:25:01.120145795Z [2024-07-04T02:25:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status queued for try_number 1 2024-07-04T02:25:01.143383429Z [2024-07-04T02:25:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:24:00+00:00 exited with status queued for try_number 1 2024-07-04T02:25:01.143668830Z [2024-07-04T02:25:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:24:00+00:00 exited with status queued for try_number 1 2024-07-04T02:25:01.160199204Z [2024-07-04T02:25:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc2e6d90-264d-4308-bfd8-31df6880275d 2024-07-04T02:25:01.160536823Z [2024-07-04T02:25:01.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to 579e5621-0a34-4845-98bd-f2ed06ddce0f 2024-07-04T02:25:01.163112845Z [2024-07-04T02:25:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7a33a0f-c5e7-4e48-9012-129ce5a34097 2024-07-04T02:25:04.010274916Z [2024-07-04T02:25:04.009+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:25:04.010305507Z 2024-07-04T02:25:04.010442103Z [2024-07-04T02:25:04.010+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:25:04.011155346Z [2024-07-04T02:25:04.010+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:25:04.011180107Z 2024-07-04T02:25:04.013656352Z [2024-07-04T02:25:04.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:25:04.013857171Z [2024-07-04T02:25:04.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:25:04.090042082Z [2024-07-04T02:25:04.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status queued for try_number 1 2024-07-04T02:25:04.090076241Z [2024-07-04T02:25:04.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status success for try_number 1 2024-07-04T02:25:04.102488397Z [2024-07-04T02:25:04.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b54db4c-df23-42ba-bee4-ea63186d3bf5 2024-07-04T02:25:04.103035520Z [2024-07-04T02:25:04.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:20:00+00:00, map_index=-1, run_start_date=2024-07-04 02:25:02.815908+00:00, run_end_date=2024-07-04 02:25:03.239126+00:00, run_duration=0.423218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:25:00.651056+00:00, queued_by_job_id=2, pid=4814 2024-07-04T02:25:05.269139604Z [2024-07-04T02:25:05.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:25:05.269867533Z [2024-07-04T02:25:05.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:24:00+00:00, run_id=scheduled__2024-07-04T02:24:00+00:00, run_start_date=2024-07-04 02:25:00.556445+00:00, run_end_date=2024-07-04 02:25:05.269331+00:00, run_duration=4.712886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:24:00+00:00, data_interval_end=2024-07-04 02:25:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:25:05.290629311Z [2024-07-04T02:25:05.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:25:00+00:00, run_after=2024-07-04T02:26:00+00:00 2024-07-04T02:25:05.299642129Z [2024-07-04T02:25:05.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:25:05.299879532Z [2024-07-04T02:25:05.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:24:00+00:00, run_id=scheduled__2024-07-04T02:24:00+00:00, run_start_date=2024-07-04 02:25:00.559618+00:00, run_end_date=2024-07-04 02:25:05.299496+00:00, run_duration=4.739878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:24:00+00:00, data_interval_end=2024-07-04 02:25:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:25:05.312819180Z [2024-07-04T02:25:05.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:25:00+00:00, run_after=2024-07-04T02:26:00+00:00 2024-07-04T02:25:05.362698355Z [2024-07-04T02:25:05.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:24:00+00:00 exited with status success for try_number 1 2024-07-04T02:25:05.362821915Z [2024-07-04T02:25:05.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:24:00+00:00 exited with status success for try_number 1 2024-07-04T02:25:05.370068377Z [2024-07-04T02:25:05.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:24:00+00:00, map_index=-1, run_start_date=2024-07-04 02:25:02.909882+00:00, run_end_date=2024-07-04 02:25:04.408794+00:00, run_duration=1.498912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:25:00.651056+00:00, queued_by_job_id=2, pid=4815 2024-07-04T02:25:05.370345950Z [2024-07-04T02:25:05.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:24:00+00:00, map_index=-1, run_start_date=2024-07-04 02:25:03.036076+00:00, run_end_date=2024-07-04 02:25:04.795793+00:00, run_duration=1.759717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:25:00.651056+00:00, queued_by_job_id=2, pid=4816 2024-07-04T02:25:06.471483801Z [2024-07-04T02:25:06.471+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:25:06.471522495Z 2024-07-04T02:25:06.471536625Z [2024-07-04T02:25:06.471+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:25:06.472217216Z [2024-07-04T02:25:06.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:25:06.472243238Z 2024-07-04T02:25:06.474988425Z [2024-07-04T02:25:06.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:25:06.475051000Z [2024-07-04T02:25:06.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:25:06.529396909Z [2024-07-04T02:25:06.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status queued for try_number 1 2024-07-04T02:25:06.529430312Z [2024-07-04T02:25:06.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status success for try_number 1 2024-07-04T02:25:06.536374259Z [2024-07-04T02:25:06.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1165959-ec2e-44c7-90af-a8215daa3895 2024-07-04T02:25:06.536424212Z [2024-07-04T02:25:06.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:20:00+00:00, map_index=-1, run_start_date=2024-07-04 02:25:05.736237+00:00, run_end_date=2024-07-04 02:25:06.163687+00:00, run_duration=0.42745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:25:04.011553+00:00, queued_by_job_id=2, pid=4855 2024-07-04T02:25:09.262498597Z [2024-07-04T02:25:09.262+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:25:09.262532744Z 2024-07-04T02:25:09.262823559Z [2024-07-04T02:25:09.262+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:25:09.263583586Z [2024-07-04T02:25:09.263+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:25:09.263597210Z 2024-07-04T02:25:09.266296033Z [2024-07-04T02:25:09.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:25:09.266524603Z [2024-07-04T02:25:09.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:25:09.341690816Z [2024-07-04T02:25:09.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status queued for try_number 1 2024-07-04T02:25:09.341766235Z [2024-07-04T02:25:09.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status success for try_number 1 2024-07-04T02:25:09.351237578Z [2024-07-04T02:25:09.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9603574-2a9d-4b11-bc39-85a7415e82e4 2024-07-04T02:25:09.351652995Z [2024-07-04T02:25:09.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:20:00+00:00, map_index=0, run_start_date=2024-07-04 02:25:08.217252+00:00, run_end_date=2024-07-04 02:25:08.613458+00:00, run_duration=0.396206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:25:06.472621+00:00, queued_by_job_id=2, pid=4866 2024-07-04T02:25:11.932539303Z [2024-07-04T02:25:11.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:25:11.932920537Z [2024-07-04T02:25:11.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:20:00+00:00, run_id=scheduled__2024-07-04T02:20:00+00:00, run_start_date=2024-07-04 02:25:00.550809+00:00, run_end_date=2024-07-04 02:25:11.932386+00:00, run_duration=11.381577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:20:00+00:00, data_interval_end=2024-07-04 02:25:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:25:11.943453203Z [2024-07-04T02:25:11.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:25:00+00:00, run_after=2024-07-04T02:30:00+00:00 2024-07-04T02:25:11.985239392Z [2024-07-04T02:25:11.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:20:00+00:00 exited with status success for try_number 1 2024-07-04T02:25:11.993875111Z [2024-07-04T02:25:11.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:20:00+00:00, map_index=-1, run_start_date=2024-07-04 02:25:11.239144+00:00, run_end_date=2024-07-04 02:25:11.702557+00:00, run_duration=0.463413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:25:09.264094+00:00, queued_by_job_id=2, pid=4878 2024-07-04T02:26:00.897577716Z [2024-07-04T02:26:00.896+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:26:00.917399018Z [2024-07-04T02:26:00.916+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:26:00.977964634Z [2024-07-04T02:26:00.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:26:00+00:00, run_after=2024-07-04T02:27:00+00:00 2024-07-04T02:26:01.181732118Z [2024-07-04T02:26:01.181+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:26:01.181762654Z 2024-07-04T02:26:01.181767590Z 2024-07-04T02:26:01.181771285Z 2024-07-04T02:26:01.181855004Z [2024-07-04T02:26:01.181+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:26:01.182000074Z [2024-07-04T02:26:01.181+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:26:01.182121143Z [2024-07-04T02:26:01.182+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:26:01.182826190Z [2024-07-04T02:26:01.182+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:26:01.182857560Z 2024-07-04T02:26:01.182862265Z 2024-07-04T02:26:01.182865702Z 2024-07-04T02:26:01.186952445Z [2024-07-04T02:26:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:26:01.187159352Z [2024-07-04T02:26:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:26:01.187435917Z [2024-07-04T02:26:01.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:26:01.187598155Z [2024-07-04T02:26:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:26:01.187949225Z [2024-07-04T02:26:01.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:26:01.188123149Z [2024-07-04T02:26:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:26:01.692164587Z [2024-07-04T02:26:01.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:24:00+00:00 exited with status queued for try_number 1 2024-07-04T02:26:01.694721797Z [2024-07-04T02:26:01.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status queued for try_number 1 2024-07-04T02:26:01.694992792Z [2024-07-04T02:26:01.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status queued for try_number 1 2024-07-04T02:26:01.705587499Z [2024-07-04T02:26:01.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e9ccde5-4a49-4862-9b48-59f606b2e2ca 2024-07-04T02:26:01.705850246Z [2024-07-04T02:26:01.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2083b25c-b6f5-48e0-8bc4-83c62e5d0166 2024-07-04T02:26:01.706049620Z [2024-07-04T02:26:01.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd8aed8b-f82a-4eab-86bc-6a856621d72a 2024-07-04T02:26:03.954484757Z [2024-07-04T02:26:03.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:26:03.954933040Z [2024-07-04T02:26:03.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:24:00+00:00, run_id=scheduled__2024-07-04T02:24:00+00:00, run_start_date=2024-07-04 02:26:01.023744+00:00, run_end_date=2024-07-04 02:26:03.954433+00:00, run_duration=2.930689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:24:00+00:00, data_interval_end=2024-07-04 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:26:03.965808919Z [2024-07-04T02:26:03.965+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:26:00+00:00, run_after=2024-07-04T02:28:00+00:00 2024-07-04T02:26:04.024571109Z [2024-07-04T02:26:04.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:24:00+00:00 exited with status success for try_number 1 2024-07-04T02:26:04.033614511Z [2024-07-04T02:26:04.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:24:00+00:00, map_index=-1, run_start_date=2024-07-04 02:26:02.507088+00:00, run_end_date=2024-07-04 02:26:03.090279+00:00, run_duration=0.583191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:26:01.183629+00:00, queued_by_job_id=2, pid=4896 2024-07-04T02:26:06.195277327Z [2024-07-04T02:26:06.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:26:06.195880467Z [2024-07-04T02:26:06.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:25:00+00:00, run_id=scheduled__2024-07-04T02:25:00+00:00, run_start_date=2024-07-04 02:26:01.031447+00:00, run_end_date=2024-07-04 02:26:06.195268+00:00, run_duration=5.163821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:25:00+00:00, data_interval_end=2024-07-04 02:26:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:26:06.210952741Z [2024-07-04T02:26:06.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:26:00+00:00, run_after=2024-07-04T02:27:00+00:00 2024-07-04T02:26:06.220920347Z [2024-07-04T02:26:06.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:26:06.221199902Z [2024-07-04T02:26:06.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:25:00+00:00, run_id=scheduled__2024-07-04T02:25:00+00:00, run_start_date=2024-07-04 02:26:01.039414+00:00, run_end_date=2024-07-04 02:26:06.220855+00:00, run_duration=5.181441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:25:00+00:00, data_interval_end=2024-07-04 02:26:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:26:06.231652159Z [2024-07-04T02:26:06.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:26:00+00:00, run_after=2024-07-04T02:27:00+00:00 2024-07-04T02:26:06.292074596Z [2024-07-04T02:26:06.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status success for try_number 1 2024-07-04T02:26:06.300842163Z [2024-07-04T02:26:06.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:25:00+00:00, map_index=-1, run_start_date=2024-07-04 02:26:03.840701+00:00, run_end_date=2024-07-04 02:26:05.291193+00:00, run_duration=1.450492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:26:01.183629+00:00, queued_by_job_id=2, pid=4917 2024-07-04T02:26:07.379241224Z [2024-07-04T02:26:07.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status success for try_number 1 2024-07-04T02:26:07.386354432Z [2024-07-04T02:26:07.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:25:00+00:00, map_index=-1, run_start_date=2024-07-04 02:26:04.333075+00:00, run_end_date=2024-07-04 02:26:06.104364+00:00, run_duration=1.771289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:26:01.183629+00:00, queued_by_job_id=2, pid=4936 2024-07-04T02:26:21.725596765Z [2024-07-04T02:26:21.724+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:27:00.258934896Z [2024-07-04T02:27:00.258+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:27:00+00:00, run_after=2024-07-04T02:28:00+00:00 2024-07-04T02:27:00.271708686Z [2024-07-04T02:27:00.271+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:27:00.396984134Z [2024-07-04T02:27:00.396+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:27:00.397018773Z 2024-07-04T02:27:00.397023363Z 2024-07-04T02:27:00.397361821Z [2024-07-04T02:27:00.397+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:27:00.397611480Z [2024-07-04T02:27:00.397+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:27:00.398468227Z [2024-07-04T02:27:00.398+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:27:00.398481900Z 2024-07-04T02:27:00.398486536Z 2024-07-04T02:27:00.402280475Z [2024-07-04T02:27:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:27:00.402599531Z [2024-07-04T02:27:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:27:00.403036275Z [2024-07-04T02:27:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:27:00.403296920Z [2024-07-04T02:27:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:27:01.460057603Z [2024-07-04T02:27:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:26:00+00:00 exited with status queued for try_number 1 2024-07-04T02:27:01.460344934Z [2024-07-04T02:27:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:26:00+00:00 exited with status queued for try_number 1 2024-07-04T02:27:01.471863814Z [2024-07-04T02:27:01.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65a0869b-9b04-46aa-b987-77bcb65357f5 2024-07-04T02:27:01.472484859Z [2024-07-04T02:27:01.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to 925cf778-28ee-4bf6-a9ad-d13d1c2f7406 2024-07-04T02:27:04.868165875Z [2024-07-04T02:27:04.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:27:04.868996287Z [2024-07-04T02:27:04.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:26:00+00:00, run_id=scheduled__2024-07-04T02:26:00+00:00, run_start_date=2024-07-04 02:27:00.291700+00:00, run_end_date=2024-07-04 02:27:04.868295+00:00, run_duration=4.576595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:26:00+00:00, data_interval_end=2024-07-04 02:27:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:27:04.882395823Z [2024-07-04T02:27:04.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:27:00+00:00, run_after=2024-07-04T02:28:00+00:00 2024-07-04T02:27:04.929696940Z [2024-07-04T02:27:04.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:26:00+00:00 exited with status success for try_number 1 2024-07-04T02:27:04.937173642Z [2024-07-04T02:27:04.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:26:00+00:00, map_index=-1, run_start_date=2024-07-04 02:27:02.942337+00:00, run_end_date=2024-07-04 02:27:04.428520+00:00, run_duration=1.486183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:27:00.399258+00:00, queued_by_job_id=2, pid=4982 2024-07-04T02:27:06.005445084Z [2024-07-04T02:27:06.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:27:06.007963515Z [2024-07-04T02:27:06.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:26:00+00:00, run_id=scheduled__2024-07-04T02:26:00+00:00, run_start_date=2024-07-04 02:27:00.296160+00:00, run_end_date=2024-07-04 02:27:06.007016+00:00, run_duration=5.710856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:26:00+00:00, data_interval_end=2024-07-04 02:27:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:27:06.027312850Z [2024-07-04T02:27:06.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:27:00+00:00, run_after=2024-07-04T02:28:00+00:00 2024-07-04T02:27:06.073663483Z [2024-07-04T02:27:06.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:26:00+00:00 exited with status success for try_number 1 2024-07-04T02:27:06.083287692Z [2024-07-04T02:27:06.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:26:00+00:00, map_index=-1, run_start_date=2024-07-04 02:27:02.882604+00:00, run_end_date=2024-07-04 02:27:05.083865+00:00, run_duration=2.201261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:27:00.399258+00:00, queued_by_job_id=2, pid=4981 2024-07-04T02:28:00.771745095Z [2024-07-04T02:28:00.771+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:28:00.787904957Z [2024-07-04T02:28:00.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:28:00+00:00, run_after=2024-07-04T02:29:00+00:00 2024-07-04T02:28:00.798053046Z [2024-07-04T02:28:00.797+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:28:00.882336320Z [2024-07-04T02:28:00.881+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:28:00.882367634Z 2024-07-04T02:28:00.882375399Z 2024-07-04T02:28:00.882380820Z 2024-07-04T02:28:00.883618244Z [2024-07-04T02:28:00.882+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:28:00.884710330Z [2024-07-04T02:28:00.884+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:28:00.885127658Z [2024-07-04T02:28:00.884+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:28:00.885959612Z [2024-07-04T02:28:00.885+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:28:00.885973024Z 2024-07-04T02:28:00.885977280Z 2024-07-04T02:28:00.885981589Z 2024-07-04T02:28:00.891550958Z [2024-07-04T02:28:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:28:00.891868466Z [2024-07-04T02:28:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:28:00.892229072Z [2024-07-04T02:28:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:28:00.892468933Z [2024-07-04T02:28:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:28:00.893050856Z [2024-07-04T02:28:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:28:00.893343982Z [2024-07-04T02:28:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:28:01.258868171Z [2024-07-04T02:28:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:26:00+00:00 exited with status queued for try_number 1 2024-07-04T02:28:01.259144434Z [2024-07-04T02:28:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:27:00+00:00 exited with status queued for try_number 1 2024-07-04T02:28:01.259345436Z [2024-07-04T02:28:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:27:00+00:00 exited with status queued for try_number 1 2024-07-04T02:28:01.267749052Z [2024-07-04T02:28:01.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3e9809a-fc81-4f4f-98ad-e282e9305f3e 2024-07-04T02:28:01.268020856Z [2024-07-04T02:28:01.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00698282-55ea-4a34-87b3-8ae77d5d2bfa 2024-07-04T02:28:01.268269497Z [2024-07-04T02:28:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45eb5a3c-28c0-44c8-99a7-64990f04be7c 2024-07-04T02:28:03.097004929Z [2024-07-04T02:28:03.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:28:03.097311614Z [2024-07-04T02:28:03.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:26:00+00:00, run_id=scheduled__2024-07-04T02:26:00+00:00, run_start_date=2024-07-04 02:28:00.810557+00:00, run_end_date=2024-07-04 02:28:03.096870+00:00, run_duration=2.286313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:26:00+00:00, data_interval_end=2024-07-04 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:28:03.107350976Z [2024-07-04T02:28:03.106+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:28:00+00:00, run_after=2024-07-04T02:30:00+00:00 2024-07-04T02:28:03.199830781Z [2024-07-04T02:28:03.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:26:00+00:00 exited with status success for try_number 1 2024-07-04T02:28:03.218258021Z [2024-07-04T02:28:03.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:26:00+00:00, map_index=-1, run_start_date=2024-07-04 02:28:01.740693+00:00, run_end_date=2024-07-04 02:28:02.249594+00:00, run_duration=0.508901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:28:00.886929+00:00, queued_by_job_id=2, pid=5017 2024-07-04T02:28:05.899664110Z [2024-07-04T02:28:05.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:28:05.899976131Z [2024-07-04T02:28:05.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:27:00+00:00, run_id=scheduled__2024-07-04T02:27:00+00:00, run_start_date=2024-07-04 02:28:00.812072+00:00, run_end_date=2024-07-04 02:28:05.899571+00:00, run_duration=5.087499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:27:00+00:00, data_interval_end=2024-07-04 02:28:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:28:05.909132613Z [2024-07-04T02:28:05.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:28:00+00:00, run_after=2024-07-04T02:29:00+00:00 2024-07-04T02:28:05.966060554Z [2024-07-04T02:28:05.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:27:00+00:00 exited with status success for try_number 1 2024-07-04T02:28:05.973605899Z [2024-07-04T02:28:05.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:27:00+00:00, map_index=-1, run_start_date=2024-07-04 02:28:03.066099+00:00, run_end_date=2024-07-04 02:28:05.144755+00:00, run_duration=2.078656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:28:00.886929+00:00, queued_by_job_id=2, pid=5047 2024-07-04T02:28:07.037214246Z [2024-07-04T02:28:07.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:28:07.037729129Z [2024-07-04T02:28:07.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:27:00+00:00, run_id=scheduled__2024-07-04T02:27:00+00:00, run_start_date=2024-07-04 02:28:00.813228+00:00, run_end_date=2024-07-04 02:28:07.037344+00:00, run_duration=6.224116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:27:00+00:00, data_interval_end=2024-07-04 02:28:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:28:07.047517120Z [2024-07-04T02:28:07.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:28:00+00:00, run_after=2024-07-04T02:29:00+00:00 2024-07-04T02:28:07.080321824Z [2024-07-04T02:28:07.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:27:00+00:00 exited with status success for try_number 1 2024-07-04T02:28:07.085609453Z [2024-07-04T02:28:07.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:27:00+00:00, map_index=-1, run_start_date=2024-07-04 02:28:03.053463+00:00, run_end_date=2024-07-04 02:28:05.906813+00:00, run_duration=2.85335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:28:00.886929+00:00, queued_by_job_id=2, pid=5046 2024-07-04T02:29:00.596806544Z [2024-07-04T02:29:00.596+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:29:00.611288745Z [2024-07-04T02:29:00.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:29:00+00:00, run_after=2024-07-04T02:30:00+00:00 2024-07-04T02:29:00.683635852Z [2024-07-04T02:29:00.683+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:29:00.683667603Z 2024-07-04T02:29:00.683671074Z 2024-07-04T02:29:00.683743469Z [2024-07-04T02:29:00.683+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:29:00.683925267Z [2024-07-04T02:29:00.683+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:29:00.684898532Z [2024-07-04T02:29:00.684+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:29:00.684909091Z 2024-07-04T02:29:00.684912463Z 2024-07-04T02:29:00.689718590Z [2024-07-04T02:29:00.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:29:00.690158956Z [2024-07-04T02:29:00.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:29:00.690622072Z [2024-07-04T02:29:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:29:00.691292441Z [2024-07-04T02:29:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:29:00.999413713Z [2024-07-04T02:29:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:28:00+00:00 exited with status queued for try_number 1 2024-07-04T02:29:00.999568912Z [2024-07-04T02:29:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:28:00+00:00 exited with status queued for try_number 1 2024-07-04T02:29:01.032458703Z [2024-07-04T02:29:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9b81911-d9c7-4706-80f2-0e511567b3f6 2024-07-04T02:29:01.032492505Z [2024-07-04T02:29:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to b57785fb-d23d-4420-9d1d-78fc544d6c75 2024-07-04T02:29:04.753514504Z [2024-07-04T02:29:04.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:29:04.753573484Z [2024-07-04T02:29:04.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:28:00+00:00, run_id=scheduled__2024-07-04T02:28:00+00:00, run_start_date=2024-07-04 02:29:00.624186+00:00, run_end_date=2024-07-04 02:29:04.744779+00:00, run_duration=4.120593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:28:00+00:00, data_interval_end=2024-07-04 02:29:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:29:04.764098941Z [2024-07-04T02:29:04.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:29:00+00:00, run_after=2024-07-04T02:30:00+00:00 2024-07-04T02:29:04.818295271Z [2024-07-04T02:29:04.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:28:00+00:00 exited with status success for try_number 1 2024-07-04T02:29:04.829120346Z [2024-07-04T02:29:04.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:28:00+00:00, map_index=-1, run_start_date=2024-07-04 02:29:02.940073+00:00, run_end_date=2024-07-04 02:29:04.460265+00:00, run_duration=1.520192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:29:00.685894+00:00, queued_by_job_id=2, pid=5103 2024-07-04T02:29:05.898778667Z [2024-07-04T02:29:05.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:29:05.898949134Z [2024-07-04T02:29:05.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:28:00+00:00, run_id=scheduled__2024-07-04T02:28:00+00:00, run_start_date=2024-07-04 02:29:00.625788+00:00, run_end_date=2024-07-04 02:29:05.898594+00:00, run_duration=5.272806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:28:00+00:00, data_interval_end=2024-07-04 02:29:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:29:05.910150768Z [2024-07-04T02:29:05.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:29:00+00:00, run_after=2024-07-04T02:30:00+00:00 2024-07-04T02:29:05.941021026Z [2024-07-04T02:29:05.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:28:00+00:00 exited with status success for try_number 1 2024-07-04T02:29:05.947046505Z [2024-07-04T02:29:05.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:28:00+00:00, map_index=-1, run_start_date=2024-07-04 02:29:02.805173+00:00, run_end_date=2024-07-04 02:29:04.843846+00:00, run_duration=2.038673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:29:00.685894+00:00, queued_by_job_id=2, pid=5102 2024-07-04T02:30:00.318366244Z [2024-07-04T02:30:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:30:00+00:00, run_after=2024-07-04T02:35:00+00:00 2024-07-04T02:30:00.349634800Z [2024-07-04T02:30:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:30:00+00:00, run_after=2024-07-04T02:31:00+00:00 2024-07-04T02:30:00.358919182Z [2024-07-04T02:30:00.358+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:30:00.365847878Z [2024-07-04T02:30:00.365+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:30:00.463471200Z [2024-07-04T02:30:00.463+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T02:30:00.463499457Z 2024-07-04T02:30:00.463505286Z 2024-07-04T02:30:00.463514135Z 2024-07-04T02:30:00.463519070Z 2024-07-04T02:30:00.463530720Z [2024-07-04T02:30:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:30:00.463609147Z [2024-07-04T02:30:00.463+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:30:00.463687060Z [2024-07-04T02:30:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:30:00.463760835Z [2024-07-04T02:30:00.463+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:30:00.464410486Z [2024-07-04T02:30:00.464+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:30:00.464421987Z 2024-07-04T02:30:00.464425919Z 2024-07-04T02:30:00.464429643Z 2024-07-04T02:30:00.464432913Z 2024-07-04T02:30:00.469834005Z [2024-07-04T02:30:00.469+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:30:00.469924977Z [2024-07-04T02:30:00.469+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:30:00.470130222Z [2024-07-04T02:30:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:30:00.470249563Z [2024-07-04T02:30:00.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:30:00.470394007Z [2024-07-04T02:30:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:30:00.470456791Z [2024-07-04T02:30:00.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:30:00.470660953Z [2024-07-04T02:30:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:30:00.470685185Z [2024-07-04T02:30:00.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:30:01.054176477Z [2024-07-04T02:30:01.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status queued for try_number 1 2024-07-04T02:30:01.054207310Z [2024-07-04T02:30:01.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:28:00+00:00 exited with status queued for try_number 1 2024-07-04T02:30:01.054291792Z [2024-07-04T02:30:01.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:29:00+00:00 exited with status queued for try_number 1 2024-07-04T02:30:01.054362760Z [2024-07-04T02:30:01.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:29:00+00:00 exited with status queued for try_number 1 2024-07-04T02:30:01.073719018Z [2024-07-04T02:30:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83ee9670-c558-4e28-8877-adb218f1a5c0 2024-07-04T02:30:01.073783703Z [2024-07-04T02:30:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fb15cba-1f0e-4122-b20a-3eeeb3a9fbb0 2024-07-04T02:30:01.074129598Z [2024-07-04T02:30:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to f612bf1a-3c39-4bfa-aefa-0b92e35e5663 2024-07-04T02:30:01.074355919Z [2024-07-04T02:30:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0644125-a60b-4297-8507-96024ba0ce8b 2024-07-04T02:30:02.980122810Z [2024-07-04T02:30:02.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:30:02.980533409Z [2024-07-04T02:30:02.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:28:00+00:00, run_id=scheduled__2024-07-04T02:28:00+00:00, run_start_date=2024-07-04 02:30:00.378755+00:00, run_end_date=2024-07-04 02:30:02.979987+00:00, run_duration=2.601232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:28:00+00:00, data_interval_end=2024-07-04 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:30:02.995220240Z [2024-07-04T02:30:02.993+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:30:00+00:00, run_after=2024-07-04T02:32:00+00:00 2024-07-04T02:30:03.150824842Z [2024-07-04T02:30:03.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:28:00+00:00 exited with status success for try_number 1 2024-07-04T02:30:03.169615338Z [2024-07-04T02:30:03.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:28:00+00:00, map_index=-1, run_start_date=2024-07-04 02:30:01.787789+00:00, run_end_date=2024-07-04 02:30:02.358844+00:00, run_duration=0.571055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:30:00.465442+00:00, queued_by_job_id=2, pid=5140 2024-07-04T02:30:04.269087962Z [2024-07-04T02:30:04.268+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:30:04.269120607Z 2024-07-04T02:30:04.269294594Z [2024-07-04T02:30:04.268+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:30:04.270117981Z [2024-07-04T02:30:04.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:30:04.270132399Z 2024-07-04T02:30:04.273373463Z [2024-07-04T02:30:04.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:30:04.273616161Z [2024-07-04T02:30:04.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:30:04.339860238Z [2024-07-04T02:30:04.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status queued for try_number 1 2024-07-04T02:30:04.339905696Z [2024-07-04T02:30:04.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status success for try_number 1 2024-07-04T02:30:04.346790610Z [2024-07-04T02:30:04.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b8de9f2-82da-4234-a62e-e286742f2d8d 2024-07-04T02:30:04.347010151Z [2024-07-04T02:30:04.346+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:25:00+00:00, map_index=-1, run_start_date=2024-07-04 02:30:02.763949+00:00, run_end_date=2024-07-04 02:30:03.283218+00:00, run_duration=0.519269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:30:00.465442+00:00, queued_by_job_id=2, pid=5179 2024-07-04T02:30:04.393633868Z [2024-07-04T02:30:04.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:30:04.393817963Z [2024-07-04T02:30:04.393+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:29:00+00:00, run_id=scheduled__2024-07-04T02:29:00+00:00, run_start_date=2024-07-04 02:30:00.380042+00:00, run_end_date=2024-07-04 02:30:04.393555+00:00, run_duration=4.013513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:29:00+00:00, data_interval_end=2024-07-04 02:30:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:30:04.402994545Z [2024-07-04T02:30:04.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:30:00+00:00, run_after=2024-07-04T02:31:00+00:00 2024-07-04T02:30:05.578607395Z [2024-07-04T02:30:05.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:30:05.579250353Z [2024-07-04T02:30:05.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:29:00+00:00, run_id=scheduled__2024-07-04T02:29:00+00:00, run_start_date=2024-07-04 02:30:00.381164+00:00, run_end_date=2024-07-04 02:30:05.578661+00:00, run_duration=5.197497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:29:00+00:00, data_interval_end=2024-07-04 02:30:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:30:05.595663354Z [2024-07-04T02:30:05.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:30:00+00:00, run_after=2024-07-04T02:31:00+00:00 2024-07-04T02:30:05.667230843Z [2024-07-04T02:30:05.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:29:00+00:00 exited with status success for try_number 1 2024-07-04T02:30:05.667495773Z [2024-07-04T02:30:05.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:29:00+00:00 exited with status success for try_number 1 2024-07-04T02:30:05.676067105Z [2024-07-04T02:30:05.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:29:00+00:00, map_index=-1, run_start_date=2024-07-04 02:30:02.894744+00:00, run_end_date=2024-07-04 02:30:04.349309+00:00, run_duration=1.454565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:30:00.465442+00:00, queued_by_job_id=2, pid=5180 2024-07-04T02:30:05.676348207Z [2024-07-04T02:30:05.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:29:00+00:00, map_index=-1, run_start_date=2024-07-04 02:30:02.917630+00:00, run_end_date=2024-07-04 02:30:04.679469+00:00, run_duration=1.761839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:30:00.465442+00:00, queued_by_job_id=2, pid=5181 2024-07-04T02:30:06.759940229Z [2024-07-04T02:30:06.759+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:30:06.759983450Z 2024-07-04T02:30:06.760389005Z [2024-07-04T02:30:06.760+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:30:06.761222621Z [2024-07-04T02:30:06.761+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:30:06.761237482Z 2024-07-04T02:30:06.764719787Z [2024-07-04T02:30:06.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:30:06.765104380Z [2024-07-04T02:30:06.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:30:06.836479185Z [2024-07-04T02:30:06.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status queued for try_number 1 2024-07-04T02:30:06.837627338Z [2024-07-04T02:30:06.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status success for try_number 1 2024-07-04T02:30:06.847423355Z [2024-07-04T02:30:06.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 911f5d74-5719-4226-bb5d-cdcc3e8f49d9 2024-07-04T02:30:06.848120567Z [2024-07-04T02:30:06.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:25:00+00:00, map_index=-1, run_start_date=2024-07-04 02:30:06.015107+00:00, run_end_date=2024-07-04 02:30:06.430399+00:00, run_duration=0.415292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:30:04.270575+00:00, queued_by_job_id=2, pid=5220 2024-07-04T02:30:09.587763257Z [2024-07-04T02:30:09.586+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:30:09.587789801Z 2024-07-04T02:30:09.587793947Z [2024-07-04T02:30:09.587+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:30:09.588163590Z [2024-07-04T02:30:09.587+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:30:09.588169445Z 2024-07-04T02:30:09.592421751Z [2024-07-04T02:30:09.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:30:09.592576813Z [2024-07-04T02:30:09.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:30:09.739487182Z [2024-07-04T02:30:09.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status queued for try_number 1 2024-07-04T02:30:09.739521974Z [2024-07-04T02:30:09.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status success for try_number 1 2024-07-04T02:30:09.752173883Z [2024-07-04T02:30:09.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to c34f1e6f-9e6c-41b1-84bd-6220123a7085 2024-07-04T02:30:09.752416674Z [2024-07-04T02:30:09.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:25:00+00:00, map_index=0, run_start_date=2024-07-04 02:30:08.609862+00:00, run_end_date=2024-07-04 02:30:09.041970+00:00, run_duration=0.432108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:30:06.761897+00:00, queued_by_job_id=2, pid=5232 2024-07-04T02:30:12.452878608Z [2024-07-04T02:30:12.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:30:12.453580189Z [2024-07-04T02:30:12.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:25:00+00:00, run_id=scheduled__2024-07-04T02:25:00+00:00, run_start_date=2024-07-04 02:30:00.377215+00:00, run_end_date=2024-07-04 02:30:12.452677+00:00, run_duration=12.075462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:25:00+00:00, data_interval_end=2024-07-04 02:30:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:30:12.463579697Z [2024-07-04T02:30:12.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:30:00+00:00, run_after=2024-07-04T02:35:00+00:00 2024-07-04T02:30:12.516272424Z [2024-07-04T02:30:12.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:25:00+00:00 exited with status success for try_number 1 2024-07-04T02:30:12.526245891Z [2024-07-04T02:30:12.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:25:00+00:00, map_index=-1, run_start_date=2024-07-04 02:30:11.458030+00:00, run_end_date=2024-07-04 02:30:11.921031+00:00, run_duration=0.463001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:30:09.588960+00:00, queued_by_job_id=2, pid=5244 2024-07-04T02:31:00.365694121Z [2024-07-04T02:31:00.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:31:00+00:00, run_after=2024-07-04T02:32:00+00:00 2024-07-04T02:31:00.386405997Z [2024-07-04T02:31:00.386+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:31:00.466128008Z [2024-07-04T02:31:00.465+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:31:00.466159786Z 2024-07-04T02:31:00.466163468Z 2024-07-04T02:31:00.466245882Z [2024-07-04T02:31:00.466+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:31:00.466397074Z [2024-07-04T02:31:00.466+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:31:00.467150170Z [2024-07-04T02:31:00.466+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:31:00.467165757Z 2024-07-04T02:31:00.467169184Z 2024-07-04T02:31:00.470656815Z [2024-07-04T02:31:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:31:00.470859612Z [2024-07-04T02:31:00.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:31:00.471193762Z [2024-07-04T02:31:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:31:00.471403489Z [2024-07-04T02:31:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:31:00.764684658Z [2024-07-04T02:31:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status queued for try_number 1 2024-07-04T02:31:00.765409792Z [2024-07-04T02:31:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status queued for try_number 1 2024-07-04T02:31:00.775821600Z [2024-07-04T02:31:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to efd3c103-7160-4475-98dc-0bb0fc19b95a 2024-07-04T02:31:00.776044270Z [2024-07-04T02:31:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfacd16d-f002-4265-85b7-b88492acb86b 2024-07-04T02:31:04.706118279Z [2024-07-04T02:31:04.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:31:04.706439884Z [2024-07-04T02:31:04.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:30:00+00:00, run_id=scheduled__2024-07-04T02:30:00+00:00, run_start_date=2024-07-04 02:31:00.402472+00:00, run_end_date=2024-07-04 02:31:04.706007+00:00, run_duration=4.303535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:30:00+00:00, data_interval_end=2024-07-04 02:31:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:31:04.722940372Z [2024-07-04T02:31:04.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:31:00+00:00, run_after=2024-07-04T02:32:00+00:00 2024-07-04T02:31:04.730254417Z [2024-07-04T02:31:04.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:31:04.730623544Z [2024-07-04T02:31:04.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:30:00+00:00, run_id=scheduled__2024-07-04T02:30:00+00:00, run_start_date=2024-07-04 02:31:00.404016+00:00, run_end_date=2024-07-04 02:31:04.730158+00:00, run_duration=4.326142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:30:00+00:00, data_interval_end=2024-07-04 02:31:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:31:04.744339324Z [2024-07-04T02:31:04.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:31:00+00:00, run_after=2024-07-04T02:32:00+00:00 2024-07-04T02:31:04.807033129Z [2024-07-04T02:31:04.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status success for try_number 1 2024-07-04T02:31:04.807067416Z [2024-07-04T02:31:04.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status success for try_number 1 2024-07-04T02:31:04.814133046Z [2024-07-04T02:31:04.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:30:00+00:00, map_index=-1, run_start_date=2024-07-04 02:31:02.639160+00:00, run_end_date=2024-07-04 02:31:04.085151+00:00, run_duration=1.445991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:31:00.467796+00:00, queued_by_job_id=2, pid=5280 2024-07-04T02:31:04.814291857Z [2024-07-04T02:31:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:30:00+00:00, map_index=-1, run_start_date=2024-07-04 02:31:02.731453+00:00, run_end_date=2024-07-04 02:31:04.584590+00:00, run_duration=1.853137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:31:00.467796+00:00, queued_by_job_id=2, pid=5281 2024-07-04T02:31:21.791180202Z [2024-07-04T02:31:21.789+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:32:00.154404966Z [2024-07-04T02:32:00.153+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:32:00.175883373Z [2024-07-04T02:32:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:32:00+00:00, run_after=2024-07-04T02:33:00+00:00 2024-07-04T02:32:00.186625772Z [2024-07-04T02:32:00.186+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:32:00.288392878Z [2024-07-04T02:32:00.287+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:32:00.288424432Z 2024-07-04T02:32:00.288429412Z 2024-07-04T02:32:00.288433009Z 2024-07-04T02:32:00.288803174Z [2024-07-04T02:32:00.288+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:32:00.289116398Z [2024-07-04T02:32:00.288+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:32:00.289357174Z [2024-07-04T02:32:00.289+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:32:00.290159762Z [2024-07-04T02:32:00.289+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:32:00.290210802Z 2024-07-04T02:32:00.290215846Z 2024-07-04T02:32:00.290219428Z 2024-07-04T02:32:00.295077280Z [2024-07-04T02:32:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:32:00.295264206Z [2024-07-04T02:32:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:32:00.295553377Z [2024-07-04T02:32:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:32:00.295780365Z [2024-07-04T02:32:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:32:00.296058828Z [2024-07-04T02:32:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:32:00.296216034Z [2024-07-04T02:32:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:32:00.661641832Z [2024-07-04T02:32:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status queued for try_number 1 2024-07-04T02:32:00.661836862Z [2024-07-04T02:32:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:31:00+00:00 exited with status queued for try_number 1 2024-07-04T02:32:00.661969266Z [2024-07-04T02:32:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:31:00+00:00 exited with status queued for try_number 1 2024-07-04T02:32:00.674685619Z [2024-07-04T02:32:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c7c935f-693e-4117-a2a5-f20f15066bd7 2024-07-04T02:32:00.674766649Z [2024-07-04T02:32:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 277c0d00-b603-4f8b-be1a-d869b7038bed 2024-07-04T02:32:00.674913430Z [2024-07-04T02:32:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc82a298-bca9-4a87-9e42-82777df2dea7 2024-07-04T02:32:02.043652552Z [2024-07-04T02:32:02.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:32:02.043857947Z [2024-07-04T02:32:02.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:30:00+00:00, run_id=scheduled__2024-07-04T02:30:00+00:00, run_start_date=2024-07-04 02:32:00.199781+00:00, run_end_date=2024-07-04 02:32:02.043509+00:00, run_duration=1.843728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:30:00+00:00, data_interval_end=2024-07-04 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:32:02.051415718Z [2024-07-04T02:32:02.050+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:32:00+00:00, run_after=2024-07-04T02:34:00+00:00 2024-07-04T02:32:02.118331270Z [2024-07-04T02:32:02.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status success for try_number 1 2024-07-04T02:32:02.130543442Z [2024-07-04T02:32:02.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:30:00+00:00, map_index=-1, run_start_date=2024-07-04 02:32:01.240328+00:00, run_end_date=2024-07-04 02:32:01.678071+00:00, run_duration=0.437743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:32:00.291491+00:00, queued_by_job_id=2, pid=5315 2024-07-04T02:32:05.224449294Z [2024-07-04T02:32:05.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:32:05.224661387Z [2024-07-04T02:32:05.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:31:00+00:00, run_id=scheduled__2024-07-04T02:31:00+00:00, run_start_date=2024-07-04 02:32:00.203242+00:00, run_end_date=2024-07-04 02:32:05.224277+00:00, run_duration=5.021035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:31:00+00:00, data_interval_end=2024-07-04 02:32:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:32:05.236706561Z [2024-07-04T02:32:05.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:32:00+00:00, run_after=2024-07-04T02:33:00+00:00 2024-07-04T02:32:05.246580716Z [2024-07-04T02:32:05.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:32:05.246846716Z [2024-07-04T02:32:05.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:31:00+00:00, run_id=scheduled__2024-07-04T02:31:00+00:00, run_start_date=2024-07-04 02:32:00.206319+00:00, run_end_date=2024-07-04 02:32:05.246505+00:00, run_duration=5.040186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:31:00+00:00, data_interval_end=2024-07-04 02:32:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:32:05.256887403Z [2024-07-04T02:32:05.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:32:00+00:00, run_after=2024-07-04T02:33:00+00:00 2024-07-04T02:32:05.307544765Z [2024-07-04T02:32:05.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:31:00+00:00 exited with status success for try_number 1 2024-07-04T02:32:05.307957800Z [2024-07-04T02:32:05.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:31:00+00:00 exited with status success for try_number 1 2024-07-04T02:32:05.326614615Z [2024-07-04T02:32:05.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:31:00+00:00, map_index=-1, run_start_date=2024-07-04 02:32:02.981732+00:00, run_end_date=2024-07-04 02:32:04.463258+00:00, run_duration=1.481526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:32:00.291491+00:00, queued_by_job_id=2, pid=5355 2024-07-04T02:32:05.326673446Z [2024-07-04T02:32:05.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:31:00+00:00, map_index=-1, run_start_date=2024-07-04 02:32:02.500949+00:00, run_end_date=2024-07-04 02:32:04.267651+00:00, run_duration=1.766702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:32:00.291491+00:00, queued_by_job_id=2, pid=5336 2024-07-04T02:33:01.123176329Z [2024-07-04T02:33:01.122+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:33:01.136153886Z [2024-07-04T02:33:01.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:33:00+00:00, run_after=2024-07-04T02:34:00+00:00 2024-07-04T02:33:01.203209758Z [2024-07-04T02:33:01.202+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:33:01.203248453Z 2024-07-04T02:33:01.203254929Z 2024-07-04T02:33:01.203624493Z [2024-07-04T02:33:01.203+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:33:01.203921541Z [2024-07-04T02:33:01.203+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:33:01.204961209Z [2024-07-04T02:33:01.204+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:33:01.204997448Z 2024-07-04T02:33:01.205003893Z 2024-07-04T02:33:01.209755617Z [2024-07-04T02:33:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:33:01.210327565Z [2024-07-04T02:33:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:33:01.210802207Z [2024-07-04T02:33:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:33:01.211160806Z [2024-07-04T02:33:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:33:01.377662101Z [2024-07-04T02:33:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:32:00+00:00 exited with status queued for try_number 1 2024-07-04T02:33:01.377703946Z [2024-07-04T02:33:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:32:00+00:00 exited with status queued for try_number 1 2024-07-04T02:33:01.386040416Z [2024-07-04T02:33:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78089f1d-5cf5-4b7d-8e01-cffbf81790e5 2024-07-04T02:33:01.386289667Z [2024-07-04T02:33:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54498b65-3ea6-4e58-8248-4dbcf9bbf571 2024-07-04T02:33:04.586643560Z [2024-07-04T02:33:04.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:33:04.586996596Z [2024-07-04T02:33:04.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:32:00+00:00, run_id=scheduled__2024-07-04T02:32:00+00:00, run_start_date=2024-07-04 02:33:01.146373+00:00, run_end_date=2024-07-04 02:33:04.586382+00:00, run_duration=3.440009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:32:00+00:00, data_interval_end=2024-07-04 02:33:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:33:04.599160423Z [2024-07-04T02:33:04.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:33:00+00:00, run_after=2024-07-04T02:34:00+00:00 2024-07-04T02:33:04.644742147Z [2024-07-04T02:33:04.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:32:00+00:00 exited with status success for try_number 1 2024-07-04T02:33:04.654247955Z [2024-07-04T02:33:04.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:32:00+00:00, map_index=-1, run_start_date=2024-07-04 02:33:03.042125+00:00, run_end_date=2024-07-04 02:33:04.465608+00:00, run_duration=1.423483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:33:01.206037+00:00, queued_by_job_id=2, pid=5400 2024-07-04T02:33:05.145433491Z [2024-07-04T02:33:05.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:33:05.145799312Z [2024-07-04T02:33:05.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:32:00+00:00, run_id=scheduled__2024-07-04T02:32:00+00:00, run_start_date=2024-07-04 02:33:01.147696+00:00, run_end_date=2024-07-04 02:33:05.145414+00:00, run_duration=3.997718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:32:00+00:00, data_interval_end=2024-07-04 02:33:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:33:05.158481327Z [2024-07-04T02:33:05.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:33:00+00:00, run_after=2024-07-04T02:34:00+00:00 2024-07-04T02:33:05.199594165Z [2024-07-04T02:33:05.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:32:00+00:00 exited with status success for try_number 1 2024-07-04T02:33:05.207586848Z [2024-07-04T02:33:05.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:32:00+00:00, map_index=-1, run_start_date=2024-07-04 02:33:02.958360+00:00, run_end_date=2024-07-04 02:33:04.786532+00:00, run_duration=1.828172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:33:01.206037+00:00, queued_by_job_id=2, pid=5399 2024-07-04T02:34:00.270918390Z [2024-07-04T02:34:00.270+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:34:00.293089987Z [2024-07-04T02:34:00.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:34:00+00:00, run_after=2024-07-04T02:35:00+00:00 2024-07-04T02:34:00.303814362Z [2024-07-04T02:34:00.303+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:34:00.423795777Z [2024-07-04T02:34:00.423+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:34:00.423827818Z 2024-07-04T02:34:00.423834637Z 2024-07-04T02:34:00.423837994Z 2024-07-04T02:34:00.423909310Z [2024-07-04T02:34:00.423+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:34:00.424021867Z [2024-07-04T02:34:00.423+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:34:00.424148120Z [2024-07-04T02:34:00.424+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:34:00.424851519Z [2024-07-04T02:34:00.424+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:34:00.424866077Z 2024-07-04T02:34:00.424869821Z 2024-07-04T02:34:00.424873790Z 2024-07-04T02:34:00.428652892Z [2024-07-04T02:34:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:34:00.428845602Z [2024-07-04T02:34:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:34:00.429099278Z [2024-07-04T02:34:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:34:00.429243100Z [2024-07-04T02:34:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:34:00.429513626Z [2024-07-04T02:34:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:34:00.429667504Z [2024-07-04T02:34:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:34:00.766941283Z [2024-07-04T02:34:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:32:00+00:00 exited with status queued for try_number 1 2024-07-04T02:34:00.767235773Z [2024-07-04T02:34:00.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:33:00+00:00 exited with status queued for try_number 1 2024-07-04T02:34:00.767397313Z [2024-07-04T02:34:00.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:33:00+00:00 exited with status queued for try_number 1 2024-07-04T02:34:00.776629212Z [2024-07-04T02:34:00.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d6e5a23-ad16-42a8-a46c-99d43778b239 2024-07-04T02:34:00.776862192Z [2024-07-04T02:34:00.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to c92e1c9a-33bb-4455-8fde-fe7e48a50a54 2024-07-04T02:34:00.777075652Z [2024-07-04T02:34:00.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2b35a42-864d-4894-99c6-795fa6c06fd7 2024-07-04T02:34:03.373150658Z [2024-07-04T02:34:03.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:34:03.373515169Z [2024-07-04T02:34:03.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:32:00+00:00, run_id=scheduled__2024-07-04T02:32:00+00:00, run_start_date=2024-07-04 02:34:00.327956+00:00, run_end_date=2024-07-04 02:34:03.373150+00:00, run_duration=3.045194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:32:00+00:00, data_interval_end=2024-07-04 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:34:03.381258640Z [2024-07-04T02:34:03.380+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:34:00+00:00, run_after=2024-07-04T02:36:00+00:00 2024-07-04T02:34:03.485527929Z [2024-07-04T02:34:03.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:32:00+00:00 exited with status success for try_number 1 2024-07-04T02:34:03.496951153Z [2024-07-04T02:34:03.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:32:00+00:00, map_index=-1, run_start_date=2024-07-04 02:34:01.663194+00:00, run_end_date=2024-07-04 02:34:02.363343+00:00, run_duration=0.700149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:34:00.425681+00:00, queued_by_job_id=2, pid=5435 2024-07-04T02:34:05.040272004Z [2024-07-04T02:34:05.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:34:05.040733080Z [2024-07-04T02:34:05.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:33:00+00:00, run_id=scheduled__2024-07-04T02:33:00+00:00, run_start_date=2024-07-04 02:34:00.331670+00:00, run_end_date=2024-07-04 02:34:05.040291+00:00, run_duration=4.708621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:33:00+00:00, data_interval_end=2024-07-04 02:34:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:34:05.052945929Z [2024-07-04T02:34:05.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:34:00+00:00, run_after=2024-07-04T02:35:00+00:00 2024-07-04T02:34:06.242826953Z [2024-07-04T02:34:06.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:34:06.243349877Z [2024-07-04T02:34:06.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:33:00+00:00, run_id=scheduled__2024-07-04T02:33:00+00:00, run_start_date=2024-07-04 02:34:00.338243+00:00, run_end_date=2024-07-04 02:34:06.242677+00:00, run_duration=5.904434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:33:00+00:00, data_interval_end=2024-07-04 02:34:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:34:06.262306406Z [2024-07-04T02:34:06.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:34:00+00:00, run_after=2024-07-04T02:35:00+00:00 2024-07-04T02:34:06.309965791Z [2024-07-04T02:34:06.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:33:00+00:00 exited with status success for try_number 1 2024-07-04T02:34:06.310668428Z [2024-07-04T02:34:06.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:33:00+00:00 exited with status success for try_number 1 2024-07-04T02:34:06.324036339Z [2024-07-04T02:34:06.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:33:00+00:00, map_index=-1, run_start_date=2024-07-04 02:34:03.324223+00:00, run_end_date=2024-07-04 02:34:04.980704+00:00, run_duration=1.656481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:34:00.425681+00:00, queued_by_job_id=2, pid=5465 2024-07-04T02:34:06.324592794Z [2024-07-04T02:34:06.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:33:00+00:00, map_index=-1, run_start_date=2024-07-04 02:34:03.536056+00:00, run_end_date=2024-07-04 02:34:05.709264+00:00, run_duration=2.173208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:34:00.425681+00:00, queued_by_job_id=2, pid=5466 2024-07-04T02:35:00.296153059Z [2024-07-04T02:35:00.295+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:35:00.317441932Z [2024-07-04T02:35:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:35:00+00:00, run_after=2024-07-04T02:36:00+00:00 2024-07-04T02:35:00.332574075Z [2024-07-04T02:35:00.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:35:00+00:00, run_after=2024-07-04T02:40:00+00:00 2024-07-04T02:35:00.417128894Z [2024-07-04T02:35:00.416+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:35:00.417163167Z 2024-07-04T02:35:00.417167444Z 2024-07-04T02:35:00.417170625Z 2024-07-04T02:35:00.417422072Z [2024-07-04T02:35:00.417+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:35:00.417613549Z [2024-07-04T02:35:00.417+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:35:00.417776932Z [2024-07-04T02:35:00.417+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:35:00.418455945Z [2024-07-04T02:35:00.418+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:35:00.418483588Z 2024-07-04T02:35:00.418489748Z 2024-07-04T02:35:00.418494438Z 2024-07-04T02:35:00.422244320Z [2024-07-04T02:35:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:35:00.422450091Z [2024-07-04T02:35:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:35:00.422721903Z [2024-07-04T02:35:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:35:00.422925667Z [2024-07-04T02:35:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:35:00.423193229Z [2024-07-04T02:35:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:35:00.423360067Z [2024-07-04T02:35:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:35:00.840936364Z [2024-07-04T02:35:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status queued for try_number 1 2024-07-04T02:35:00.841594460Z [2024-07-04T02:35:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:34:00+00:00 exited with status queued for try_number 1 2024-07-04T02:35:00.842097922Z [2024-07-04T02:35:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:34:00+00:00 exited with status queued for try_number 1 2024-07-04T02:35:00.872209048Z [2024-07-04T02:35:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 001894cb-3b3b-4924-b087-609e3649afd0 2024-07-04T02:35:00.872534236Z [2024-07-04T02:35:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc6654bd-bd75-4231-bb69-30e3393a9a86 2024-07-04T02:35:00.873509745Z [2024-07-04T02:35:00.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30884790-59e6-44d5-9a09-ea2e50a4151e 2024-07-04T02:35:04.597601987Z [2024-07-04T02:35:04.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:35:04.597909865Z [2024-07-04T02:35:04.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:34:00+00:00, run_id=scheduled__2024-07-04T02:34:00+00:00, run_start_date=2024-07-04 02:35:00.351357+00:00, run_end_date=2024-07-04 02:35:04.597321+00:00, run_duration=4.245964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:34:00+00:00, data_interval_end=2024-07-04 02:35:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:35:04.607030070Z [2024-07-04T02:35:04.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:35:00+00:00, run_after=2024-07-04T02:36:00+00:00 2024-07-04T02:35:04.647436373Z [2024-07-04T02:35:04.636+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:35:04.647465546Z 2024-07-04T02:35:04.647472429Z [2024-07-04T02:35:04.637+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:35:04.647477644Z [2024-07-04T02:35:04.638+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:35:04.647482204Z 2024-07-04T02:35:04.647487405Z [2024-07-04T02:35:04.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:35:04.647492879Z [2024-07-04T02:35:04.643+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:35:04.702277626Z [2024-07-04T02:35:04.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status queued for try_number 1 2024-07-04T02:35:04.702731539Z [2024-07-04T02:35:04.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status success for try_number 1 2024-07-04T02:35:04.703136570Z [2024-07-04T02:35:04.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:34:00+00:00 exited with status success for try_number 1 2024-07-04T02:35:04.740166918Z [2024-07-04T02:35:04.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:34:00+00:00, map_index=-1, run_start_date=2024-07-04 02:35:02.954312+00:00, run_end_date=2024-07-04 02:35:04.358696+00:00, run_duration=1.404384, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:35:00.419301+00:00, queued_by_job_id=2, pid=5522 2024-07-04T02:35:04.740191738Z [2024-07-04T02:35:04.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:30:00+00:00, map_index=-1, run_start_date=2024-07-04 02:35:03.064710+00:00, run_end_date=2024-07-04 02:35:03.505847+00:00, run_duration=0.441137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:35:00.419301+00:00, queued_by_job_id=2, pid=5523 2024-07-04T02:35:04.740196219Z [2024-07-04T02:35:04.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 772140c2-84b2-4d0f-aec6-ddbd43bf0bb5 2024-07-04T02:35:05.622559901Z [2024-07-04T02:35:05.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:35:05.622953564Z [2024-07-04T02:35:05.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:34:00+00:00, run_id=scheduled__2024-07-04T02:34:00+00:00, run_start_date=2024-07-04 02:35:00.352619+00:00, run_end_date=2024-07-04 02:35:05.622403+00:00, run_duration=5.269784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:34:00+00:00, data_interval_end=2024-07-04 02:35:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:35:05.636393144Z [2024-07-04T02:35:05.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:35:00+00:00, run_after=2024-07-04T02:36:00+00:00 2024-07-04T02:35:05.699808624Z [2024-07-04T02:35:05.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:34:00+00:00 exited with status success for try_number 1 2024-07-04T02:35:05.708511329Z [2024-07-04T02:35:05.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:34:00+00:00, map_index=-1, run_start_date=2024-07-04 02:35:03.548311+00:00, run_end_date=2024-07-04 02:35:05.302386+00:00, run_duration=1.754075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:35:00.419301+00:00, queued_by_job_id=2, pid=5551 2024-07-04T02:35:07.440841583Z [2024-07-04T02:35:07.440+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:35:07.440900279Z 2024-07-04T02:35:07.440905001Z [2024-07-04T02:35:07.440+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:35:07.441777816Z [2024-07-04T02:35:07.441+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:35:07.441799978Z 2024-07-04T02:35:07.445690645Z [2024-07-04T02:35:07.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:35:07.445877232Z [2024-07-04T02:35:07.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:35:07.525754003Z [2024-07-04T02:35:07.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status queued for try_number 1 2024-07-04T02:35:07.530930465Z [2024-07-04T02:35:07.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status success for try_number 1 2024-07-04T02:35:07.549775496Z [2024-07-04T02:35:07.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64fbd902-a00f-43c4-91b3-06bd8f224d6b 2024-07-04T02:35:07.549985398Z [2024-07-04T02:35:07.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:30:00+00:00, map_index=-1, run_start_date=2024-07-04 02:35:06.308572+00:00, run_end_date=2024-07-04 02:35:06.648440+00:00, run_duration=0.339868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:35:04.639439+00:00, queued_by_job_id=2, pid=5572 2024-07-04T02:35:09.868056727Z [2024-07-04T02:35:09.867+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:35:09.868086171Z 2024-07-04T02:35:09.868123235Z [2024-07-04T02:35:09.867+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:35:09.868660841Z [2024-07-04T02:35:09.868+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:35:09.868669562Z 2024-07-04T02:35:09.871315172Z [2024-07-04T02:35:09.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:35:09.871387467Z [2024-07-04T02:35:09.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:35:10.000386412Z [2024-07-04T02:35:09.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status queued for try_number 1 2024-07-04T02:35:10.005061272Z [2024-07-04T02:35:10.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status success for try_number 1 2024-07-04T02:35:10.018306800Z [2024-07-04T02:35:10.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2915c80-87ce-45b4-ae7c-7338f422aed7 2024-07-04T02:35:10.018734769Z [2024-07-04T02:35:10.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:30:00+00:00, map_index=0, run_start_date=2024-07-04 02:35:09.140228+00:00, run_end_date=2024-07-04 02:35:09.593921+00:00, run_duration=0.453693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:35:07.442914+00:00, queued_by_job_id=2, pid=5584 2024-07-04T02:35:12.312321223Z [2024-07-04T02:35:12.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:35:12.312695540Z [2024-07-04T02:35:12.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:30:00+00:00, run_id=scheduled__2024-07-04T02:30:00+00:00, run_start_date=2024-07-04 02:35:00.347247+00:00, run_end_date=2024-07-04 02:35:12.312286+00:00, run_duration=11.965039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:30:00+00:00, data_interval_end=2024-07-04 02:35:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:35:12.322677963Z [2024-07-04T02:35:12.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:35:00+00:00, run_after=2024-07-04T02:40:00+00:00 2024-07-04T02:35:12.366515342Z [2024-07-04T02:35:12.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:30:00+00:00 exited with status success for try_number 1 2024-07-04T02:35:12.375300785Z [2024-07-04T02:35:12.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:30:00+00:00, map_index=-1, run_start_date=2024-07-04 02:35:11.597417+00:00, run_end_date=2024-07-04 02:35:11.974328+00:00, run_duration=0.376911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:35:09.869063+00:00, queued_by_job_id=2, pid=5596 2024-07-04T02:36:00.498703176Z [2024-07-04T02:36:00.498+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:36:00.518541746Z [2024-07-04T02:36:00.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:36:00+00:00, run_after=2024-07-04T02:37:00+00:00 2024-07-04T02:36:00.530907046Z [2024-07-04T02:36:00.530+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:36:00.641108981Z [2024-07-04T02:36:00.640+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:36:00.641144382Z 2024-07-04T02:36:00.641250024Z 2024-07-04T02:36:00.641306173Z 2024-07-04T02:36:00.641341268Z [2024-07-04T02:36:00.640+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:36:00.641346303Z [2024-07-04T02:36:00.641+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:36:00.641350826Z [2024-07-04T02:36:00.641+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:36:00.641977951Z [2024-07-04T02:36:00.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:36:00.641992375Z 2024-07-04T02:36:00.641997604Z 2024-07-04T02:36:00.642013335Z 2024-07-04T02:36:00.645740538Z [2024-07-04T02:36:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:36:00.645785401Z [2024-07-04T02:36:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:36:00.646037132Z [2024-07-04T02:36:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:36:00.646085068Z [2024-07-04T02:36:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:36:00.646317061Z [2024-07-04T02:36:00.646+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:36:00.646398252Z [2024-07-04T02:36:00.646+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:36:00.954045385Z [2024-07-04T02:36:00.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:34:00+00:00 exited with status queued for try_number 1 2024-07-04T02:36:00.954375851Z [2024-07-04T02:36:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status queued for try_number 1 2024-07-04T02:36:00.954529653Z [2024-07-04T02:36:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status queued for try_number 1 2024-07-04T02:36:00.974247942Z [2024-07-04T02:36:00.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to 230ed8bb-bf7f-4af1-835c-704466f2e77f 2024-07-04T02:36:00.974561471Z [2024-07-04T02:36:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ed739e8-9240-4c7d-8cbe-689eef91fe56 2024-07-04T02:36:00.974756071Z [2024-07-04T02:36:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2eef276-de4f-4537-be36-c9666d60b3c2 2024-07-04T02:36:03.389991156Z [2024-07-04T02:36:03.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:36:03.390361477Z [2024-07-04T02:36:03.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:34:00+00:00, run_id=scheduled__2024-07-04T02:34:00+00:00, run_start_date=2024-07-04 02:36:00.567931+00:00, run_end_date=2024-07-04 02:36:03.389782+00:00, run_duration=2.821851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:34:00+00:00, data_interval_end=2024-07-04 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:36:03.400433127Z [2024-07-04T02:36:03.399+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:36:00+00:00, run_after=2024-07-04T02:38:00+00:00 2024-07-04T02:36:03.449990693Z [2024-07-04T02:36:03.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:34:00+00:00 exited with status success for try_number 1 2024-07-04T02:36:03.456324740Z [2024-07-04T02:36:03.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:34:00+00:00, map_index=-1, run_start_date=2024-07-04 02:36:01.856369+00:00, run_end_date=2024-07-04 02:36:02.390480+00:00, run_duration=0.534111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:36:00.642682+00:00, queued_by_job_id=2, pid=5615 2024-07-04T02:36:04.515467749Z [2024-07-04T02:36:04.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:36:04.515626711Z [2024-07-04T02:36:04.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:35:00+00:00, run_id=scheduled__2024-07-04T02:35:00+00:00, run_start_date=2024-07-04 02:36:00.571527+00:00, run_end_date=2024-07-04 02:36:04.515372+00:00, run_duration=3.943845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:35:00+00:00, data_interval_end=2024-07-04 02:36:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:36:04.540299258Z [2024-07-04T02:36:04.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:36:00+00:00, run_after=2024-07-04T02:37:00+00:00 2024-07-04T02:36:04.551452317Z [2024-07-04T02:36:04.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:36:04.552870073Z [2024-07-04T02:36:04.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:35:00+00:00, run_id=scheduled__2024-07-04T02:35:00+00:00, run_start_date=2024-07-04 02:36:00.572834+00:00, run_end_date=2024-07-04 02:36:04.551359+00:00, run_duration=3.978525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:35:00+00:00, data_interval_end=2024-07-04 02:36:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:36:04.569841511Z [2024-07-04T02:36:04.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:36:00+00:00, run_after=2024-07-04T02:37:00+00:00 2024-07-04T02:36:04.615434499Z [2024-07-04T02:36:04.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status success for try_number 1 2024-07-04T02:36:04.625599926Z [2024-07-04T02:36:04.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:35:00+00:00, map_index=-1, run_start_date=2024-07-04 02:36:02.767670+00:00, run_end_date=2024-07-04 02:36:04.369707+00:00, run_duration=1.602037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:36:00.642682+00:00, queued_by_job_id=2, pid=5644 2024-07-04T02:36:05.703175492Z [2024-07-04T02:36:05.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status success for try_number 1 2024-07-04T02:36:05.708346099Z [2024-07-04T02:36:05.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:35:00+00:00, map_index=-1, run_start_date=2024-07-04 02:36:02.687419+00:00, run_end_date=2024-07-04 02:36:04.437200+00:00, run_duration=1.749781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:36:00.642682+00:00, queued_by_job_id=2, pid=5643 2024-07-04T02:36:21.864593288Z [2024-07-04T02:36:21.853+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:37:00.417837856Z [2024-07-04T02:37:00.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:37:00+00:00, run_after=2024-07-04T02:38:00+00:00 2024-07-04T02:37:00.426593661Z [2024-07-04T02:37:00.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:37:00.498062609Z [2024-07-04T02:37:00.497+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:37:00.498101279Z 2024-07-04T02:37:00.498105534Z 2024-07-04T02:37:00.498237623Z [2024-07-04T02:37:00.498+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:37:00.498367040Z [2024-07-04T02:37:00.498+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:37:00.499060622Z [2024-07-04T02:37:00.498+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:37:00.499133514Z 2024-07-04T02:37:00.499137731Z 2024-07-04T02:37:00.502510231Z [2024-07-04T02:37:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:37:00.502680181Z [2024-07-04T02:37:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:37:00.502984437Z [2024-07-04T02:37:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:37:00.503149683Z [2024-07-04T02:37:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:37:00.871074075Z [2024-07-04T02:37:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:36:00+00:00 exited with status queued for try_number 1 2024-07-04T02:37:00.871124299Z [2024-07-04T02:37:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:36:00+00:00 exited with status queued for try_number 1 2024-07-04T02:37:00.882217347Z [2024-07-04T02:37:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 246bf131-23ed-4d46-b4d9-d4b3dd2bf306 2024-07-04T02:37:00.882332842Z [2024-07-04T02:37:00.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57921fd2-966a-4329-8027-791df01f241b 2024-07-04T02:37:04.457080652Z [2024-07-04T02:37:04.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:37:04.457571721Z [2024-07-04T02:37:04.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:36:00+00:00, run_id=scheduled__2024-07-04T02:36:00+00:00, run_start_date=2024-07-04 02:37:00.443099+00:00, run_end_date=2024-07-04 02:37:04.457125+00:00, run_duration=4.014026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:36:00+00:00, data_interval_end=2024-07-04 02:37:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:37:04.469425314Z [2024-07-04T02:37:04.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:37:00+00:00, run_after=2024-07-04T02:38:00+00:00 2024-07-04T02:37:05.615935844Z [2024-07-04T02:37:05.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:37:05.616480579Z [2024-07-04T02:37:05.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:36:00+00:00, run_id=scheduled__2024-07-04T02:36:00+00:00, run_start_date=2024-07-04 02:37:00.445492+00:00, run_end_date=2024-07-04 02:37:05.616013+00:00, run_duration=5.170521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:36:00+00:00, data_interval_end=2024-07-04 02:37:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:37:05.635052065Z [2024-07-04T02:37:05.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:37:00+00:00, run_after=2024-07-04T02:38:00+00:00 2024-07-04T02:37:05.690828544Z [2024-07-04T02:37:05.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:36:00+00:00 exited with status success for try_number 1 2024-07-04T02:37:05.691360004Z [2024-07-04T02:37:05.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:36:00+00:00 exited with status success for try_number 1 2024-07-04T02:37:05.701458152Z [2024-07-04T02:37:05.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:36:00+00:00, map_index=-1, run_start_date=2024-07-04 02:37:02.584570+00:00, run_end_date=2024-07-04 02:37:04.411331+00:00, run_duration=1.826761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:37:00.499673+00:00, queued_by_job_id=2, pid=5699 2024-07-04T02:37:05.701898403Z [2024-07-04T02:37:05.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:36:00+00:00, map_index=-1, run_start_date=2024-07-04 02:37:02.431175+00:00, run_end_date=2024-07-04 02:37:04.850217+00:00, run_duration=2.419042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:37:00.499673+00:00, queued_by_job_id=2, pid=5698 2024-07-04T02:38:00.308296906Z [2024-07-04T02:38:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:38:00+00:00, run_after=2024-07-04T02:39:00+00:00 2024-07-04T02:38:00.322234139Z [2024-07-04T02:38:00.321+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:38:00.329542243Z [2024-07-04T02:38:00.329+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:38:00.446949078Z [2024-07-04T02:38:00.446+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:38:00.446973390Z 2024-07-04T02:38:00.446983112Z 2024-07-04T02:38:00.446986619Z 2024-07-04T02:38:00.447165750Z [2024-07-04T02:38:00.446+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:38:00.447403700Z [2024-07-04T02:38:00.447+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:38:00.447570910Z [2024-07-04T02:38:00.447+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:38:00.448347581Z [2024-07-04T02:38:00.448+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:38:00.448359499Z 2024-07-04T02:38:00.448363558Z 2024-07-04T02:38:00.448367348Z 2024-07-04T02:38:00.455242345Z [2024-07-04T02:38:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:38:00.455509289Z [2024-07-04T02:38:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:38:00.456086329Z [2024-07-04T02:38:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:38:00.456266590Z [2024-07-04T02:38:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:38:00.456604375Z [2024-07-04T02:38:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:38:00.456777764Z [2024-07-04T02:38:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:38:00.910798169Z [2024-07-04T02:38:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:36:00+00:00 exited with status queued for try_number 1 2024-07-04T02:38:00.914611834Z [2024-07-04T02:38:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:37:00+00:00 exited with status queued for try_number 1 2024-07-04T02:38:00.915043811Z [2024-07-04T02:38:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:37:00+00:00 exited with status queued for try_number 1 2024-07-04T02:38:00.932324619Z [2024-07-04T02:38:00.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to 566c5e2e-c94c-4e2c-a896-d54efda9f8c4 2024-07-04T02:38:00.933880658Z [2024-07-04T02:38:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60b9f0c8-511c-4798-960b-ba24f4719313 2024-07-04T02:38:00.934140846Z [2024-07-04T02:38:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3867a07-da27-4f89-9673-9fcaf27eed56 2024-07-04T02:38:02.186199462Z [2024-07-04T02:38:02.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:38:02.186653648Z [2024-07-04T02:38:02.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:36:00+00:00, run_id=scheduled__2024-07-04T02:36:00+00:00, run_start_date=2024-07-04 02:38:00.344494+00:00, run_end_date=2024-07-04 02:38:02.186102+00:00, run_duration=1.841608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:36:00+00:00, data_interval_end=2024-07-04 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:38:02.196238358Z [2024-07-04T02:38:02.195+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:38:00+00:00, run_after=2024-07-04T02:40:00+00:00 2024-07-04T02:38:03.378247826Z [2024-07-04T02:38:03.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:36:00+00:00 exited with status success for try_number 1 2024-07-04T02:38:03.385841496Z [2024-07-04T02:38:03.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:36:00+00:00, map_index=-1, run_start_date=2024-07-04 02:38:01.628912+00:00, run_end_date=2024-07-04 02:38:02.103760+00:00, run_duration=0.474848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:38:00.449199+00:00, queued_by_job_id=2, pid=5734 2024-07-04T02:38:05.563940150Z [2024-07-04T02:38:05.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:38:05.564535912Z [2024-07-04T02:38:05.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:37:00+00:00, run_id=scheduled__2024-07-04T02:37:00+00:00, run_start_date=2024-07-04 02:38:00.347773+00:00, run_end_date=2024-07-04 02:38:05.563836+00:00, run_duration=5.216063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:37:00+00:00, data_interval_end=2024-07-04 02:38:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:38:05.573018667Z [2024-07-04T02:38:05.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:38:00+00:00, run_after=2024-07-04T02:39:00+00:00 2024-07-04T02:38:05.579177534Z [2024-07-04T02:38:05.578+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:38:05.579721317Z [2024-07-04T02:38:05.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:37:00+00:00, run_id=scheduled__2024-07-04T02:37:00+00:00, run_start_date=2024-07-04 02:38:00.350724+00:00, run_end_date=2024-07-04 02:38:05.579114+00:00, run_duration=5.22839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:37:00+00:00, data_interval_end=2024-07-04 02:38:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:38:05.589092883Z [2024-07-04T02:38:05.588+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:38:00+00:00, run_after=2024-07-04T02:39:00+00:00 2024-07-04T02:38:05.621890668Z [2024-07-04T02:38:05.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:37:00+00:00 exited with status success for try_number 1 2024-07-04T02:38:05.621917113Z [2024-07-04T02:38:05.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:37:00+00:00 exited with status success for try_number 1 2024-07-04T02:38:05.628494497Z [2024-07-04T02:38:05.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:37:00+00:00, map_index=-1, run_start_date=2024-07-04 02:38:02.798352+00:00, run_end_date=2024-07-04 02:38:04.778680+00:00, run_duration=1.980328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:38:00.449199+00:00, queued_by_job_id=2, pid=5765 2024-07-04T02:38:05.628735964Z [2024-07-04T02:38:05.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:37:00+00:00, map_index=-1, run_start_date=2024-07-04 02:38:02.788388+00:00, run_end_date=2024-07-04 02:38:05.439082+00:00, run_duration=2.650694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:38:00.449199+00:00, queued_by_job_id=2, pid=5764 2024-07-04T02:39:00.525256139Z [2024-07-04T02:39:00.524+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:39:00.544360890Z [2024-07-04T02:39:00.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:39:00+00:00, run_after=2024-07-04T02:40:00+00:00 2024-07-04T02:39:00.630223023Z [2024-07-04T02:39:00.629+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:39:00.630275246Z 2024-07-04T02:39:00.630284067Z 2024-07-04T02:39:00.630645791Z [2024-07-04T02:39:00.630+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:39:00.630902483Z [2024-07-04T02:39:00.630+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:39:00.632134725Z [2024-07-04T02:39:00.631+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:39:00.632147434Z 2024-07-04T02:39:00.632152703Z 2024-07-04T02:39:00.638225420Z [2024-07-04T02:39:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:39:00.638457193Z [2024-07-04T02:39:00.638+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:39:00.638991747Z [2024-07-04T02:39:00.638+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:39:00.639642349Z [2024-07-04T02:39:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:39:00.948347222Z [2024-07-04T02:39:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:38:00+00:00 exited with status queued for try_number 1 2024-07-04T02:39:00.948395545Z [2024-07-04T02:39:00.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:38:00+00:00 exited with status queued for try_number 1 2024-07-04T02:39:00.961017800Z [2024-07-04T02:39:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5586376e-27a9-42c3-ad16-10e8dd560401 2024-07-04T02:39:00.961252663Z [2024-07-04T02:39:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbfb7cbd-fe8f-4c9d-a7f4-88ec6d9b94d4 2024-07-04T02:39:04.234070009Z [2024-07-04T02:39:04.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:39:04.234595385Z [2024-07-04T02:39:04.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:38:00+00:00, run_id=scheduled__2024-07-04T02:38:00+00:00, run_start_date=2024-07-04 02:39:00.559462+00:00, run_end_date=2024-07-04 02:39:04.233962+00:00, run_duration=3.6745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:38:00+00:00, data_interval_end=2024-07-04 02:39:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:39:04.249412839Z [2024-07-04T02:39:04.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:39:00+00:00, run_after=2024-07-04T02:40:00+00:00 2024-07-04T02:39:04.318449571Z [2024-07-04T02:39:04.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:38:00+00:00 exited with status success for try_number 1 2024-07-04T02:39:04.326132694Z [2024-07-04T02:39:04.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:38:00+00:00, map_index=-1, run_start_date=2024-07-04 02:39:02.520869+00:00, run_end_date=2024-07-04 02:39:03.771146+00:00, run_duration=1.250277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:39:00.633861+00:00, queued_by_job_id=2, pid=5819 2024-07-04T02:39:05.378609104Z [2024-07-04T02:39:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:39:05.378739005Z [2024-07-04T02:39:05.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:38:00+00:00, run_id=scheduled__2024-07-04T02:38:00+00:00, run_start_date=2024-07-04 02:39:00.560930+00:00, run_end_date=2024-07-04 02:39:05.378422+00:00, run_duration=4.817492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:38:00+00:00, data_interval_end=2024-07-04 02:39:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:39:05.387985807Z [2024-07-04T02:39:05.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:39:00+00:00, run_after=2024-07-04T02:40:00+00:00 2024-07-04T02:39:05.430370669Z [2024-07-04T02:39:05.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:38:00+00:00 exited with status success for try_number 1 2024-07-04T02:39:05.437306316Z [2024-07-04T02:39:05.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:38:00+00:00, map_index=-1, run_start_date=2024-07-04 02:39:02.513073+00:00, run_end_date=2024-07-04 02:39:04.429568+00:00, run_duration=1.916495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:39:00.633861+00:00, queued_by_job_id=2, pid=5818 2024-07-04T02:40:01.100497813Z [2024-07-04T02:40:01.099+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:40:01.115049322Z [2024-07-04T02:40:01.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:40:00+00:00, run_after=2024-07-04T02:45:00+00:00 2024-07-04T02:40:01.128706568Z [2024-07-04T02:40:01.128+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:40:01.154120063Z [2024-07-04T02:40:01.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:40:00+00:00, run_after=2024-07-04T02:41:00+00:00 2024-07-04T02:40:01.292950533Z [2024-07-04T02:40:01.292+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T02:40:01.293016945Z 2024-07-04T02:40:01.293025596Z 2024-07-04T02:40:01.293033776Z 2024-07-04T02:40:01.293040841Z 2024-07-04T02:40:01.293170422Z [2024-07-04T02:40:01.292+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:40:01.293813359Z [2024-07-04T02:40:01.293+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:40:01.294279372Z [2024-07-04T02:40:01.293+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:40:01.294690826Z [2024-07-04T02:40:01.294+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:40:01.296113250Z [2024-07-04T02:40:01.295+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:40:01.296134317Z 2024-07-04T02:40:01.296141198Z 2024-07-04T02:40:01.296147576Z 2024-07-04T02:40:01.296152930Z 2024-07-04T02:40:01.303492250Z [2024-07-04T02:40:01.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:40:01.303757282Z [2024-07-04T02:40:01.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:40:01.304132722Z [2024-07-04T02:40:01.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:40:01.304373822Z [2024-07-04T02:40:01.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:40:01.304773698Z [2024-07-04T02:40:01.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:40:01.304931449Z [2024-07-04T02:40:01.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:40:01.305218032Z [2024-07-04T02:40:01.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:40:01.305323408Z [2024-07-04T02:40:01.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:40:02.004114532Z [2024-07-04T02:40:02.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status queued for try_number 1 2024-07-04T02:40:02.007558681Z [2024-07-04T02:40:02.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:38:00+00:00 exited with status queued for try_number 1 2024-07-04T02:40:02.008002089Z [2024-07-04T02:40:02.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:39:00+00:00 exited with status queued for try_number 1 2024-07-04T02:40:02.008100241Z [2024-07-04T02:40:02.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:39:00+00:00 exited with status queued for try_number 1 2024-07-04T02:40:02.034191933Z [2024-07-04T02:40:02.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 359ace65-3eb3-499a-8cd8-d0dc33774e06 2024-07-04T02:40:02.034466419Z [2024-07-04T02:40:02.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94e7d7d4-7a7e-4f90-85c9-f565070969c4 2024-07-04T02:40:02.034686941Z [2024-07-04T02:40:02.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b4cd74c-4b44-4d64-80e8-3f103e5b63a1 2024-07-04T02:40:02.034823825Z [2024-07-04T02:40:02.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to 006db01d-8f9d-47c6-a70e-d36ea3b5a420 2024-07-04T02:40:03.008661534Z [2024-07-04T02:40:03.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:40:03.008949253Z [2024-07-04T02:40:03.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:38:00+00:00, run_id=scheduled__2024-07-04T02:38:00+00:00, run_start_date=2024-07-04 02:40:01.172789+00:00, run_end_date=2024-07-04 02:40:03.008614+00:00, run_duration=1.835825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:38:00+00:00, data_interval_end=2024-07-04 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:40:03.027669348Z [2024-07-04T02:40:03.027+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:40:00+00:00, run_after=2024-07-04T02:42:00+00:00 2024-07-04T02:40:03.110426402Z [2024-07-04T02:40:03.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:38:00+00:00 exited with status success for try_number 1 2024-07-04T02:40:03.119256666Z [2024-07-04T02:40:03.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:38:00+00:00, map_index=-1, run_start_date=2024-07-04 02:40:02.287092+00:00, run_end_date=2024-07-04 02:40:02.848919+00:00, run_duration=0.561827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:40:01.298190+00:00, queued_by_job_id=2, pid=5856 2024-07-04T02:40:05.436136246Z [2024-07-04T02:40:05.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:40:05.436337066Z [2024-07-04T02:40:05.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:39:00+00:00, run_id=scheduled__2024-07-04T02:39:00+00:00, run_start_date=2024-07-04 02:40:01.174914+00:00, run_end_date=2024-07-04 02:40:05.436016+00:00, run_duration=4.261102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:39:00+00:00, data_interval_end=2024-07-04 02:40:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:40:05.447501852Z [2024-07-04T02:40:05.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:40:00+00:00, run_after=2024-07-04T02:41:00+00:00 2024-07-04T02:40:05.484858823Z [2024-07-04T02:40:05.484+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:40:05.484899479Z 2024-07-04T02:40:05.485786334Z [2024-07-04T02:40:05.485+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:40:05.487328501Z [2024-07-04T02:40:05.486+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:40:05.487356305Z 2024-07-04T02:40:05.493710034Z [2024-07-04T02:40:05.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:40:05.493966053Z [2024-07-04T02:40:05.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:40:05.574860776Z [2024-07-04T02:40:05.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status queued for try_number 1 2024-07-04T02:40:05.575320147Z [2024-07-04T02:40:05.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status success for try_number 1 2024-07-04T02:40:05.575579701Z [2024-07-04T02:40:05.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:39:00+00:00 exited with status success for try_number 1 2024-07-04T02:40:05.583779945Z [2024-07-04T02:40:05.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5094754e-9a44-4f37-a7c2-243f2cda5076 2024-07-04T02:40:05.584161410Z [2024-07-04T02:40:05.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:35:00+00:00, map_index=-1, run_start_date=2024-07-04 02:40:03.992579+00:00, run_end_date=2024-07-04 02:40:04.424909+00:00, run_duration=0.43233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:40:01.298190+00:00, queued_by_job_id=2, pid=5906 2024-07-04T02:40:05.584669083Z [2024-07-04T02:40:05.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:39:00+00:00, map_index=-1, run_start_date=2024-07-04 02:40:03.322560+00:00, run_end_date=2024-07-04 02:40:04.844061+00:00, run_duration=1.521501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:40:01.298190+00:00, queued_by_job_id=2, pid=5878 2024-07-04T02:40:06.793839704Z [2024-07-04T02:40:06.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:40:06.794192196Z [2024-07-04T02:40:06.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:39:00+00:00, run_id=scheduled__2024-07-04T02:39:00+00:00, run_start_date=2024-07-04 02:40:01.176295+00:00, run_end_date=2024-07-04 02:40:06.793768+00:00, run_duration=5.617473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:39:00+00:00, data_interval_end=2024-07-04 02:40:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:40:06.814102283Z [2024-07-04T02:40:06.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:40:00+00:00, run_after=2024-07-04T02:41:00+00:00 2024-07-04T02:40:06.874563413Z [2024-07-04T02:40:06.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:39:00+00:00 exited with status success for try_number 1 2024-07-04T02:40:06.883229988Z [2024-07-04T02:40:06.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:39:00+00:00, map_index=-1, run_start_date=2024-07-04 02:40:04.038214+00:00, run_end_date=2024-07-04 02:40:05.712000+00:00, run_duration=1.673786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:40:01.298190+00:00, queued_by_job_id=2, pid=5907 2024-07-04T02:40:08.238039174Z [2024-07-04T02:40:08.237+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:40:08.238113409Z 2024-07-04T02:40:08.238117967Z [2024-07-04T02:40:08.237+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:40:08.240109604Z [2024-07-04T02:40:08.239+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:40:08.240131080Z 2024-07-04T02:40:08.245146198Z [2024-07-04T02:40:08.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:40:08.245417668Z [2024-07-04T02:40:08.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:40:08.346034725Z [2024-07-04T02:40:08.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status queued for try_number 1 2024-07-04T02:40:08.347582786Z [2024-07-04T02:40:08.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status success for try_number 1 2024-07-04T02:40:08.358987800Z [2024-07-04T02:40:08.358+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2a9770e-08ca-4856-af9d-9a500a5c6afb 2024-07-04T02:40:08.359466649Z [2024-07-04T02:40:08.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:35:00+00:00, map_index=-1, run_start_date=2024-07-04 02:40:07.202492+00:00, run_end_date=2024-07-04 02:40:07.636021+00:00, run_duration=0.433529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:40:05.488642+00:00, queued_by_job_id=2, pid=5937 2024-07-04T02:40:11.868037377Z [2024-07-04T02:40:11.867+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:40:11.868081900Z 2024-07-04T02:40:11.868090220Z [2024-07-04T02:40:11.867+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:40:11.868503991Z [2024-07-04T02:40:11.868+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:40:11.868515894Z 2024-07-04T02:40:11.870670482Z [2024-07-04T02:40:11.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:40:11.870691847Z [2024-07-04T02:40:11.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:40:11.987041243Z [2024-07-04T02:40:11.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status queued for try_number 1 2024-07-04T02:40:11.987078865Z [2024-07-04T02:40:11.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status success for try_number 1 2024-07-04T02:40:11.993811604Z [2024-07-04T02:40:11.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 634c4200-a89b-4b58-a6e3-3fcb60b3a15f 2024-07-04T02:40:11.994105057Z [2024-07-04T02:40:11.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:35:00+00:00, map_index=0, run_start_date=2024-07-04 02:40:10.239352+00:00, run_end_date=2024-07-04 02:40:10.657246+00:00, run_duration=0.417894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:40:08.241084+00:00, queued_by_job_id=2, pid=5949 2024-07-04T02:40:14.540860550Z [2024-07-04T02:40:14.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:40:14.541200142Z [2024-07-04T02:40:14.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:35:00+00:00, run_id=scheduled__2024-07-04T02:35:00+00:00, run_start_date=2024-07-04 02:40:01.171081+00:00, run_end_date=2024-07-04 02:40:14.540841+00:00, run_duration=13.36976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:35:00+00:00, data_interval_end=2024-07-04 02:40:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:40:14.547025618Z [2024-07-04T02:40:14.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:40:00+00:00, run_after=2024-07-04T02:45:00+00:00 2024-07-04T02:40:14.589087343Z [2024-07-04T02:40:14.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:35:00+00:00 exited with status success for try_number 1 2024-07-04T02:40:14.596837989Z [2024-07-04T02:40:14.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:35:00+00:00, map_index=-1, run_start_date=2024-07-04 02:40:13.788862+00:00, run_end_date=2024-07-04 02:40:14.153172+00:00, run_duration=0.36431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:40:11.868754+00:00, queued_by_job_id=2, pid=5961 2024-07-04T02:41:00.296784168Z [2024-07-04T02:41:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:41:00+00:00, run_after=2024-07-04T02:42:00+00:00 2024-07-04T02:41:00.310853498Z [2024-07-04T02:41:00.308+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:41:00.391929817Z [2024-07-04T02:41:00.391+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:41:00.391962524Z 2024-07-04T02:41:00.391966389Z 2024-07-04T02:41:00.392149980Z [2024-07-04T02:41:00.391+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:41:00.392348101Z [2024-07-04T02:41:00.392+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:41:00.393229586Z [2024-07-04T02:41:00.393+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:41:00.393242068Z 2024-07-04T02:41:00.393245571Z 2024-07-04T02:41:00.396489847Z [2024-07-04T02:41:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:41:00.396634975Z [2024-07-04T02:41:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:41:00.396876303Z [2024-07-04T02:41:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:41:00.396997185Z [2024-07-04T02:41:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:41:00.667490327Z [2024-07-04T02:41:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:41:00.667740662Z [2024-07-04T02:41:00.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:41:00.691104966Z [2024-07-04T02:41:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c7da80e-9194-4c7a-a669-4e217e473465 2024-07-04T02:41:00.691427609Z [2024-07-04T02:41:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56aa14ea-7021-4131-80c7-537bc7412de4 2024-07-04T02:41:04.188331626Z [2024-07-04T02:41:04.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:41:04.188753828Z [2024-07-04T02:41:04.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:40:00+00:00, run_id=scheduled__2024-07-04T02:40:00+00:00, run_start_date=2024-07-04 02:41:00.336618+00:00, run_end_date=2024-07-04 02:41:04.188387+00:00, run_duration=3.851769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:40:00+00:00, data_interval_end=2024-07-04 02:41:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:41:04.198395791Z [2024-07-04T02:41:04.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:41:00+00:00, run_after=2024-07-04T02:42:00+00:00 2024-07-04T02:41:04.239496338Z [2024-07-04T02:41:04.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:41:04.239687116Z [2024-07-04T02:41:04.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:41:04.246005037Z [2024-07-04T02:41:04.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=-1, run_start_date=2024-07-04 02:41:02.530328+00:00, run_end_date=2024-07-04 02:41:04.084140+00:00, run_duration=1.553812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:41:00.394033+00:00, queued_by_job_id=2, pid=5998 2024-07-04T02:41:04.246668487Z [2024-07-04T02:41:04.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=-1, run_start_date=2024-07-04 02:41:02.253792+00:00, run_end_date=2024-07-04 02:41:03.970405+00:00, run_duration=1.716613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:41:00.394033+00:00, queued_by_job_id=2, pid=5990 2024-07-04T02:41:05.315063605Z [2024-07-04T02:41:05.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:41:05.315489368Z [2024-07-04T02:41:05.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:40:00+00:00, run_id=scheduled__2024-07-04T02:40:00+00:00, run_start_date=2024-07-04 02:41:00.333926+00:00, run_end_date=2024-07-04 02:41:05.314866+00:00, run_duration=4.98094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:40:00+00:00, data_interval_end=2024-07-04 02:41:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:41:05.326664433Z [2024-07-04T02:41:05.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:41:00+00:00, run_after=2024-07-04T02:42:00+00:00 2024-07-04T02:41:21.943731410Z [2024-07-04T02:41:21.941+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:42:00.098342914Z [2024-07-04T02:42:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:42:00+00:00, run_after=2024-07-04T02:43:00+00:00 2024-07-04T02:42:00.112638401Z [2024-07-04T02:42:00.112+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:42:00.120578911Z [2024-07-04T02:42:00.120+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:42:00.187021796Z [2024-07-04T02:42:00.186+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:42:00.187063325Z 2024-07-04T02:42:00.187067675Z 2024-07-04T02:42:00.187071488Z 2024-07-04T02:42:00.187263967Z [2024-07-04T02:42:00.187+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:42:00.187376667Z [2024-07-04T02:42:00.187+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:42:00.187537626Z [2024-07-04T02:42:00.187+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:42:00.188219350Z [2024-07-04T02:42:00.188+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:42:00.188246886Z 2024-07-04T02:42:00.188250483Z 2024-07-04T02:42:00.188253514Z 2024-07-04T02:42:00.191903285Z [2024-07-04T02:42:00.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:42:00.192171772Z [2024-07-04T02:42:00.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:42:00.192442109Z [2024-07-04T02:42:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:42:00.192575289Z [2024-07-04T02:42:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:42:00.192805802Z [2024-07-04T02:42:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:42:00.192959173Z [2024-07-04T02:42:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:42:00.505352994Z [2024-07-04T02:42:00.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:42:00.505637635Z [2024-07-04T02:42:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:41:00+00:00 exited with status queued for try_number 1 2024-07-04T02:42:00.505863123Z [2024-07-04T02:42:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:41:00+00:00 exited with status queued for try_number 1 2024-07-04T02:42:00.532059543Z [2024-07-04T02:42:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to faa2d8c3-ad39-46f4-825b-daa24ad037c5 2024-07-04T02:42:00.532800415Z [2024-07-04T02:42:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8044bb48-cf76-4127-81a9-0a665deddea5 2024-07-04T02:42:00.533112604Z [2024-07-04T02:42:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e68f3c4-d0d1-4b12-a8b1-ab3ec8c25e3f 2024-07-04T02:42:03.163798095Z [2024-07-04T02:42:03.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:42:03.164170738Z [2024-07-04T02:42:03.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:40:00+00:00, run_id=scheduled__2024-07-04T02:40:00+00:00, run_start_date=2024-07-04 02:42:00.133051+00:00, run_end_date=2024-07-04 02:42:03.163766+00:00, run_duration=3.030715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:40:00+00:00, data_interval_end=2024-07-04 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:42:03.172448924Z [2024-07-04T02:42:03.172+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:42:00+00:00, run_after=2024-07-04T02:44:00+00:00 2024-07-04T02:42:03.252590979Z [2024-07-04T02:42:03.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:42:03.269474534Z [2024-07-04T02:42:03.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=-1, run_start_date=2024-07-04 02:42:01.686286+00:00, run_end_date=2024-07-04 02:42:02.349579+00:00, run_duration=0.663293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:42:00.189036+00:00, queued_by_job_id=2, pid=6034 2024-07-04T02:42:05.411380071Z [2024-07-04T02:42:05.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:42:05.411976187Z [2024-07-04T02:42:05.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:41:00+00:00, run_id=scheduled__2024-07-04T02:41:00+00:00, run_start_date=2024-07-04 02:42:00.134599+00:00, run_end_date=2024-07-04 02:42:05.411224+00:00, run_duration=5.276625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:41:00+00:00, data_interval_end=2024-07-04 02:42:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:42:05.425779309Z [2024-07-04T02:42:05.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:42:00+00:00, run_after=2024-07-04T02:43:00+00:00 2024-07-04T02:42:05.437296612Z [2024-07-04T02:42:05.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:42:05.438768752Z [2024-07-04T02:42:05.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:41:00+00:00, run_id=scheduled__2024-07-04T02:41:00+00:00, run_start_date=2024-07-04 02:42:00.135795+00:00, run_end_date=2024-07-04 02:42:05.437459+00:00, run_duration=5.301664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:41:00+00:00, data_interval_end=2024-07-04 02:42:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:42:05.464241779Z [2024-07-04T02:42:05.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:42:00+00:00, run_after=2024-07-04T02:43:00+00:00 2024-07-04T02:42:05.510676725Z [2024-07-04T02:42:05.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:41:00+00:00 exited with status success for try_number 1 2024-07-04T02:42:05.511038742Z [2024-07-04T02:42:05.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:41:00+00:00 exited with status success for try_number 1 2024-07-04T02:42:05.518907289Z [2024-07-04T02:42:05.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:41:00+00:00, map_index=-1, run_start_date=2024-07-04 02:42:03.438655+00:00, run_end_date=2024-07-04 02:42:04.767800+00:00, run_duration=1.329145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:42:00.189036+00:00, queued_by_job_id=2, pid=6064 2024-07-04T02:42:05.519328328Z [2024-07-04T02:42:05.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:41:00+00:00, map_index=-1, run_start_date=2024-07-04 02:42:03.520646+00:00, run_end_date=2024-07-04 02:42:05.145078+00:00, run_duration=1.624432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:42:00.189036+00:00, queued_by_job_id=2, pid=6065 2024-07-04T02:43:00.167300916Z [2024-07-04T02:43:00.166+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:43:00.181578284Z [2024-07-04T02:43:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:43:00+00:00, run_after=2024-07-04T02:44:00+00:00 2024-07-04T02:43:00.269075795Z [2024-07-04T02:43:00.268+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:43:00.269108757Z 2024-07-04T02:43:00.269112868Z 2024-07-04T02:43:00.269303544Z [2024-07-04T02:43:00.268+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:43:00.269444759Z [2024-07-04T02:43:00.269+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:43:00.270264181Z [2024-07-04T02:43:00.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:43:00.270282766Z 2024-07-04T02:43:00.270289181Z 2024-07-04T02:43:00.275852045Z [2024-07-04T02:43:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:43:00.276092791Z [2024-07-04T02:43:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:43:00.276451854Z [2024-07-04T02:43:00.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:43:00.276609116Z [2024-07-04T02:43:00.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:43:00.517160385Z [2024-07-04T02:43:00.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:42:00+00:00 exited with status queued for try_number 1 2024-07-04T02:43:00.519546381Z [2024-07-04T02:43:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:42:00+00:00 exited with status queued for try_number 1 2024-07-04T02:43:00.533780659Z [2024-07-04T02:43:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70b63013-3501-4e12-b163-3f51d2ac714d 2024-07-04T02:43:00.534187977Z [2024-07-04T02:43:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 857797db-5847-4634-aacf-a9e43f9f64bf 2024-07-04T02:43:04.819375791Z [2024-07-04T02:43:04.817+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:43:04.819430776Z [2024-07-04T02:43:04.818+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:42:00+00:00, run_id=scheduled__2024-07-04T02:42:00+00:00, run_start_date=2024-07-04 02:43:00.197368+00:00, run_end_date=2024-07-04 02:43:04.818498+00:00, run_duration=4.62113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:42:00+00:00, data_interval_end=2024-07-04 02:43:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:43:04.828852311Z [2024-07-04T02:43:04.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:43:00+00:00, run_after=2024-07-04T02:44:00+00:00 2024-07-04T02:43:04.837523994Z [2024-07-04T02:43:04.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:43:04.838261179Z [2024-07-04T02:43:04.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:42:00+00:00, run_id=scheduled__2024-07-04T02:42:00+00:00, run_start_date=2024-07-04 02:43:00.199140+00:00, run_end_date=2024-07-04 02:43:04.837416+00:00, run_duration=4.638276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:42:00+00:00, data_interval_end=2024-07-04 02:43:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:43:04.848723425Z [2024-07-04T02:43:04.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:43:00+00:00, run_after=2024-07-04T02:44:00+00:00 2024-07-04T02:43:04.898583942Z [2024-07-04T02:43:04.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:42:00+00:00 exited with status success for try_number 1 2024-07-04T02:43:04.899386238Z [2024-07-04T02:43:04.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:42:00+00:00 exited with status success for try_number 1 2024-07-04T02:43:04.917631025Z [2024-07-04T02:43:04.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:42:00+00:00, map_index=-1, run_start_date=2024-07-04 02:43:02.417071+00:00, run_end_date=2024-07-04 02:43:03.830815+00:00, run_duration=1.413744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:43:00.270971+00:00, queued_by_job_id=2, pid=6119 2024-07-04T02:43:04.918193302Z [2024-07-04T02:43:04.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:42:00+00:00, map_index=-1, run_start_date=2024-07-04 02:43:02.457847+00:00, run_end_date=2024-07-04 02:43:04.279891+00:00, run_duration=1.822044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:43:00.270971+00:00, queued_by_job_id=2, pid=6120 2024-07-04T02:44:00.582690327Z [2024-07-04T02:44:00.582+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:44:00.598622526Z [2024-07-04T02:44:00.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:44:00+00:00, run_after=2024-07-04T02:45:00+00:00 2024-07-04T02:44:00.606253619Z [2024-07-04T02:44:00.605+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:44:00.682418613Z [2024-07-04T02:44:00.681+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:44:00.682459635Z 2024-07-04T02:44:00.682465354Z 2024-07-04T02:44:00.682470895Z 2024-07-04T02:44:00.682624776Z [2024-07-04T02:44:00.682+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:44:00.682828068Z [2024-07-04T02:44:00.682+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:44:00.683077925Z [2024-07-04T02:44:00.682+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:44:00.683991266Z [2024-07-04T02:44:00.683+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:44:00.684004272Z 2024-07-04T02:44:00.684009967Z 2024-07-04T02:44:00.684014681Z 2024-07-04T02:44:00.691089469Z [2024-07-04T02:44:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:44:00.692100193Z [2024-07-04T02:44:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:44:00.692495380Z [2024-07-04T02:44:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:44:00.692601081Z [2024-07-04T02:44:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:44:00.692890153Z [2024-07-04T02:44:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:44:00.693016859Z [2024-07-04T02:44:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:44:01.148356044Z [2024-07-04T02:44:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:42:00+00:00 exited with status queued for try_number 1 2024-07-04T02:44:01.148611216Z [2024-07-04T02:44:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:43:00+00:00 exited with status queued for try_number 1 2024-07-04T02:44:01.148744154Z [2024-07-04T02:44:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:43:00+00:00 exited with status queued for try_number 1 2024-07-04T02:44:01.166175863Z [2024-07-04T02:44:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff2e7057-dd47-4735-acc8-1ecbfbb8de91 2024-07-04T02:44:01.166551306Z [2024-07-04T02:44:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bfe6c6a-ecc8-4af9-97ba-2516e437f69a 2024-07-04T02:44:01.166936545Z [2024-07-04T02:44:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9e529d7-1004-4faf-973c-3813f1f061dc 2024-07-04T02:44:02.321060695Z [2024-07-04T02:44:02.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:44:02.321841803Z [2024-07-04T02:44:02.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:42:00+00:00, run_id=scheduled__2024-07-04T02:42:00+00:00, run_start_date=2024-07-04 02:44:00.616062+00:00, run_end_date=2024-07-04 02:44:02.321422+00:00, run_duration=1.70536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:42:00+00:00, data_interval_end=2024-07-04 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:44:02.329037246Z [2024-07-04T02:44:02.328+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:44:00+00:00, run_after=2024-07-04T02:46:00+00:00 2024-07-04T02:44:02.374164472Z [2024-07-04T02:44:02.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:42:00+00:00 exited with status success for try_number 1 2024-07-04T02:44:02.390078347Z [2024-07-04T02:44:02.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:42:00+00:00, map_index=-1, run_start_date=2024-07-04 02:44:01.663089+00:00, run_end_date=2024-07-04 02:44:02.092654+00:00, run_duration=0.429565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:44:00.685193+00:00, queued_by_job_id=2, pid=6155 2024-07-04T02:44:04.569869326Z [2024-07-04T02:44:04.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:44:04.570073461Z [2024-07-04T02:44:04.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:43:00+00:00, run_id=scheduled__2024-07-04T02:43:00+00:00, run_start_date=2024-07-04 02:44:00.617450+00:00, run_end_date=2024-07-04 02:44:04.569616+00:00, run_duration=3.952166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:43:00+00:00, data_interval_end=2024-07-04 02:44:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:44:04.584383019Z [2024-07-04T02:44:04.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:44:00+00:00, run_after=2024-07-04T02:45:00+00:00 2024-07-04T02:44:04.592017674Z [2024-07-04T02:44:04.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:44:04.592281144Z [2024-07-04T02:44:04.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:43:00+00:00, run_id=scheduled__2024-07-04T02:43:00+00:00, run_start_date=2024-07-04 02:44:00.618540+00:00, run_end_date=2024-07-04 02:44:04.591871+00:00, run_duration=3.973331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:43:00+00:00, data_interval_end=2024-07-04 02:44:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:44:04.600373947Z [2024-07-04T02:44:04.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:44:00+00:00, run_after=2024-07-04T02:45:00+00:00 2024-07-04T02:44:04.640856074Z [2024-07-04T02:44:04.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:43:00+00:00 exited with status success for try_number 1 2024-07-04T02:44:04.641389512Z [2024-07-04T02:44:04.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:43:00+00:00 exited with status success for try_number 1 2024-07-04T02:44:04.650849997Z [2024-07-04T02:44:04.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:43:00+00:00, map_index=-1, run_start_date=2024-07-04 02:44:02.559503+00:00, run_end_date=2024-07-04 02:44:03.848900+00:00, run_duration=1.289397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:44:00.685193+00:00, queued_by_job_id=2, pid=6185 2024-07-04T02:44:04.652106633Z [2024-07-04T02:44:04.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:43:00+00:00, map_index=-1, run_start_date=2024-07-04 02:44:02.734711+00:00, run_end_date=2024-07-04 02:44:04.291338+00:00, run_duration=1.556627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:44:00.685193+00:00, queued_by_job_id=2, pid=6186 2024-07-04T02:45:01.121120908Z [2024-07-04T02:45:01.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:45:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:45:01.132860661Z [2024-07-04T02:45:01.132+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:45:01.152068889Z [2024-07-04T02:45:01.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:45:00+00:00, run_after=2024-07-04T02:46:00+00:00 2024-07-04T02:45:01.274647372Z [2024-07-04T02:45:01.274+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:45:01.274690488Z 2024-07-04T02:45:01.274701076Z 2024-07-04T02:45:01.274707046Z 2024-07-04T02:45:01.275158163Z [2024-07-04T02:45:01.274+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:45:01.275805578Z [2024-07-04T02:45:01.275+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:45:01.276202956Z [2024-07-04T02:45:01.275+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:45:01.277951553Z [2024-07-04T02:45:01.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:45:01.277976255Z 2024-07-04T02:45:01.277985003Z 2024-07-04T02:45:01.277992944Z 2024-07-04T02:45:01.296228965Z [2024-07-04T02:45:01.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:45:01.296560549Z [2024-07-04T02:45:01.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:45:01.296985610Z [2024-07-04T02:45:01.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:45:01.297223288Z [2024-07-04T02:45:01.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:45:01.297604724Z [2024-07-04T02:45:01.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:45:01.297873876Z [2024-07-04T02:45:01.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:45:01.572777126Z [2024-07-04T02:45:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:45:01.573058143Z [2024-07-04T02:45:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:44:00+00:00 exited with status queued for try_number 1 2024-07-04T02:45:01.573476096Z [2024-07-04T02:45:01.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:44:00+00:00 exited with status queued for try_number 1 2024-07-04T02:45:01.583215932Z [2024-07-04T02:45:01.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to 312b8453-5aac-4554-bddd-13871152693e 2024-07-04T02:45:01.583462689Z [2024-07-04T02:45:01.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd429493-4079-47e2-87a9-027795499b33 2024-07-04T02:45:01.583707222Z [2024-07-04T02:45:01.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d1179f6-753f-4989-8441-aefcd0e95f6d 2024-07-04T02:45:04.529135020Z [2024-07-04T02:45:04.528+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:45:04.529187960Z 2024-07-04T02:45:04.530008289Z [2024-07-04T02:45:04.529+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:45:04.530922140Z [2024-07-04T02:45:04.530+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:45:04.530944787Z 2024-07-04T02:45:04.534332159Z [2024-07-04T02:45:04.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:45:04.534617351Z [2024-07-04T02:45:04.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:45:04.609869807Z [2024-07-04T02:45:04.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:45:04.609954261Z [2024-07-04T02:45:04.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:45:04.619379112Z [2024-07-04T02:45:04.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9077e633-8e51-4915-a8d8-08d4cb54cc8a 2024-07-04T02:45:04.619633651Z [2024-07-04T02:45:04.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=-1, run_start_date=2024-07-04 02:45:03.300925+00:00, run_end_date=2024-07-04 02:45:03.734126+00:00, run_duration=0.433201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:45:01.279830+00:00, queued_by_job_id=2, pid=6253 2024-07-04T02:45:05.789745958Z [2024-07-04T02:45:05.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:45:05.790083515Z [2024-07-04T02:45:05.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:44:00+00:00, run_id=scheduled__2024-07-04T02:44:00+00:00, run_start_date=2024-07-04 02:45:01.171216+00:00, run_end_date=2024-07-04 02:45:05.789494+00:00, run_duration=4.618278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:44:00+00:00, data_interval_end=2024-07-04 02:45:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:45:05.811404451Z [2024-07-04T02:45:05.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:45:00+00:00, run_after=2024-07-04T02:46:00+00:00 2024-07-04T02:45:05.819731656Z [2024-07-04T02:45:05.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:45:05.819877196Z [2024-07-04T02:45:05.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:44:00+00:00, run_id=scheduled__2024-07-04T02:44:00+00:00, run_start_date=2024-07-04 02:45:01.172955+00:00, run_end_date=2024-07-04 02:45:05.819590+00:00, run_duration=4.646635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:44:00+00:00, data_interval_end=2024-07-04 02:45:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:45:05.829002608Z [2024-07-04T02:45:05.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:45:00+00:00, run_after=2024-07-04T02:46:00+00:00 2024-07-04T02:45:05.879929378Z [2024-07-04T02:45:05.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:44:00+00:00 exited with status success for try_number 1 2024-07-04T02:45:05.880483200Z [2024-07-04T02:45:05.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:44:00+00:00 exited with status success for try_number 1 2024-07-04T02:45:05.891173967Z [2024-07-04T02:45:05.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:44:00+00:00, map_index=-1, run_start_date=2024-07-04 02:45:03.221909+00:00, run_end_date=2024-07-04 02:45:04.569800+00:00, run_duration=1.347891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:45:01.279830+00:00, queued_by_job_id=2, pid=6252 2024-07-04T02:45:05.891868402Z [2024-07-04T02:45:05.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:44:00+00:00, map_index=-1, run_start_date=2024-07-04 02:45:03.083556+00:00, run_end_date=2024-07-04 02:45:04.924816+00:00, run_duration=1.84126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:45:01.279830+00:00, queued_by_job_id=2, pid=6251 2024-07-04T02:45:06.993433151Z [2024-07-04T02:45:06.992+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:45:06.993488526Z 2024-07-04T02:45:06.993495760Z [2024-07-04T02:45:06.993+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:45:06.994104562Z [2024-07-04T02:45:06.993+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:45:06.994124039Z 2024-07-04T02:45:06.996704791Z [2024-07-04T02:45:06.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:45:06.996857608Z [2024-07-04T02:45:06.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:45:07.048452510Z [2024-07-04T02:45:07.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:45:07.048563213Z [2024-07-04T02:45:07.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:45:07.054597443Z [2024-07-04T02:45:07.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7867f87-2650-4806-8ea8-899c4b091227 2024-07-04T02:45:07.054790833Z [2024-07-04T02:45:07.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=-1, run_start_date=2024-07-04 02:45:06.287895+00:00, run_end_date=2024-07-04 02:45:06.718042+00:00, run_duration=0.430147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:45:04.531445+00:00, queued_by_job_id=2, pid=6292 2024-07-04T02:45:09.595140949Z [2024-07-04T02:45:09.591+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:45:09.595187573Z 2024-07-04T02:45:09.595192495Z [2024-07-04T02:45:09.591+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:45:09.595197169Z [2024-07-04T02:45:09.592+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:45:09.595200733Z 2024-07-04T02:45:09.595205168Z [2024-07-04T02:45:09.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:45:09.595223143Z [2024-07-04T02:45:09.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:45:09.725093419Z [2024-07-04T02:45:09.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:45:09.725129296Z [2024-07-04T02:45:09.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:45:09.730699926Z [2024-07-04T02:45:09.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9a1d6a7-6d8b-48fc-9d49-e205329a5ec3 2024-07-04T02:45:09.734986119Z [2024-07-04T02:45:09.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=0, run_start_date=2024-07-04 02:45:08.637476+00:00, run_end_date=2024-07-04 02:45:08.998101+00:00, run_duration=0.360625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:45:06.994468+00:00, queued_by_job_id=2, pid=6304 2024-07-04T02:45:12.297570760Z [2024-07-04T02:45:12.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:45:12.297791811Z [2024-07-04T02:45:12.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:40:00+00:00, run_id=scheduled__2024-07-04T02:40:00+00:00, run_start_date=2024-07-04 02:45:01.169028+00:00, run_end_date=2024-07-04 02:45:12.297488+00:00, run_duration=11.12846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:40:00+00:00, data_interval_end=2024-07-04 02:45:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:45:12.304283274Z [2024-07-04T02:45:12.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:45:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:45:12.333685810Z [2024-07-04T02:45:12.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:45:12.338612988Z [2024-07-04T02:45:12.338+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=-1, run_start_date=2024-07-04 02:45:11.248148+00:00, run_end_date=2024-07-04 02:45:11.643312+00:00, run_duration=0.395164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:45:09.592884+00:00, queued_by_job_id=2, pid=6316 2024-07-04T02:46:00.357823798Z [2024-07-04T02:46:00.357+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:46:00.374279219Z [2024-07-04T02:46:00.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:46:00+00:00, run_after=2024-07-04T02:47:00+00:00 2024-07-04T02:46:00.391188980Z [2024-07-04T02:46:00.390+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:46:00.493969111Z [2024-07-04T02:46:00.493+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:46:00.494001052Z 2024-07-04T02:46:00.494005698Z 2024-07-04T02:46:00.494009436Z 2024-07-04T02:46:00.494466191Z [2024-07-04T02:46:00.493+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:46:00.494846243Z [2024-07-04T02:46:00.494+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:46:00.495216257Z [2024-07-04T02:46:00.495+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:46:00.496324524Z [2024-07-04T02:46:00.496+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:46:00.496338691Z 2024-07-04T02:46:00.496345106Z 2024-07-04T02:46:00.496349726Z 2024-07-04T02:46:00.501280263Z [2024-07-04T02:46:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:46:00.501669085Z [2024-07-04T02:46:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:46:00.502178149Z [2024-07-04T02:46:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:46:00.502381047Z [2024-07-04T02:46:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:46:00.502678692Z [2024-07-04T02:46:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:46:00.503322109Z [2024-07-04T02:46:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:46:00.963230077Z [2024-07-04T02:46:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:44:00+00:00 exited with status queued for try_number 1 2024-07-04T02:46:00.963532296Z [2024-07-04T02:46:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status queued for try_number 1 2024-07-04T02:46:00.963814829Z [2024-07-04T02:46:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status queued for try_number 1 2024-07-04T02:46:00.976133011Z [2024-07-04T02:46:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d250ac6-3ed8-4117-beea-05a94c85c075 2024-07-04T02:46:00.983359140Z [2024-07-04T02:46:00.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7241e62-4edf-4bf8-9f2f-1c6b7369aa75 2024-07-04T02:46:00.983554078Z [2024-07-04T02:46:00.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ab23836-e99b-4173-8d93-938db4aee3c0 2024-07-04T02:46:02.266559412Z [2024-07-04T02:46:02.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:46:02.266753176Z [2024-07-04T02:46:02.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:44:00+00:00, run_id=scheduled__2024-07-04T02:44:00+00:00, run_start_date=2024-07-04 02:46:00.403657+00:00, run_end_date=2024-07-04 02:46:02.266474+00:00, run_duration=1.862817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:44:00+00:00, data_interval_end=2024-07-04 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:46:02.278098910Z [2024-07-04T02:46:02.277+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:46:00+00:00, run_after=2024-07-04T02:48:00+00:00 2024-07-04T02:46:02.337729905Z [2024-07-04T02:46:02.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:44:00+00:00 exited with status success for try_number 1 2024-07-04T02:46:02.343351334Z [2024-07-04T02:46:02.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:44:00+00:00, map_index=-1, run_start_date=2024-07-04 02:46:01.375388+00:00, run_end_date=2024-07-04 02:46:01.740440+00:00, run_duration=0.365052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:46:00.497552+00:00, queued_by_job_id=2, pid=6333 2024-07-04T02:46:04.364199170Z [2024-07-04T02:46:04.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:46:04.364456426Z [2024-07-04T02:46:04.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:45:00+00:00, run_id=scheduled__2024-07-04T02:45:00+00:00, run_start_date=2024-07-04 02:46:00.405116+00:00, run_end_date=2024-07-04 02:46:04.364015+00:00, run_duration=3.958899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:45:00+00:00, data_interval_end=2024-07-04 02:46:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:46:04.372789270Z [2024-07-04T02:46:04.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:46:00+00:00, run_after=2024-07-04T02:47:00+00:00 2024-07-04T02:46:04.416815929Z [2024-07-04T02:46:04.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status success for try_number 1 2024-07-04T02:46:04.425642721Z [2024-07-04T02:46:04.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:45:00+00:00, map_index=-1, run_start_date=2024-07-04 02:46:02.657131+00:00, run_end_date=2024-07-04 02:46:03.991684+00:00, run_duration=1.334553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:46:00.497552+00:00, queued_by_job_id=2, pid=6363 2024-07-04T02:46:05.501817718Z [2024-07-04T02:46:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:46:05.502121250Z [2024-07-04T02:46:05.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:45:00+00:00, run_id=scheduled__2024-07-04T02:45:00+00:00, run_start_date=2024-07-04 02:46:00.406284+00:00, run_end_date=2024-07-04 02:46:05.501753+00:00, run_duration=5.095469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:45:00+00:00, data_interval_end=2024-07-04 02:46:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:46:05.512272679Z [2024-07-04T02:46:05.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:46:00+00:00, run_after=2024-07-04T02:47:00+00:00 2024-07-04T02:46:05.538727649Z [2024-07-04T02:46:05.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status success for try_number 1 2024-07-04T02:46:05.543152380Z [2024-07-04T02:46:05.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:45:00+00:00, map_index=-1, run_start_date=2024-07-04 02:46:02.676216+00:00, run_end_date=2024-07-04 02:46:04.431408+00:00, run_duration=1.755192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:46:00.497552+00:00, queued_by_job_id=2, pid=6364 2024-07-04T02:46:22.006452835Z [2024-07-04T02:46:22.005+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:47:00.335698927Z [2024-07-04T02:47:00.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:47:00+00:00, run_after=2024-07-04T02:48:00+00:00 2024-07-04T02:47:00.354294391Z [2024-07-04T02:47:00.353+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:47:00.418680177Z [2024-07-04T02:47:00.418+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:47:00.418713912Z 2024-07-04T02:47:00.418717653Z 2024-07-04T02:47:00.418977534Z [2024-07-04T02:47:00.418+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:47:00.419167829Z [2024-07-04T02:47:00.419+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:47:00.419984142Z [2024-07-04T02:47:00.419+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:47:00.419996274Z 2024-07-04T02:47:00.419999697Z 2024-07-04T02:47:00.426359189Z [2024-07-04T02:47:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:47:00.426373807Z [2024-07-04T02:47:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:47:00.426377558Z [2024-07-04T02:47:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:47:00.426380938Z [2024-07-04T02:47:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:47:00.713858635Z [2024-07-04T02:47:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:46:00+00:00 exited with status queued for try_number 1 2024-07-04T02:47:00.713911270Z [2024-07-04T02:47:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:46:00+00:00 exited with status queued for try_number 1 2024-07-04T02:47:00.728192351Z [2024-07-04T02:47:00.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85095abb-1629-4c44-90c9-a13f9b4df9fd 2024-07-04T02:47:00.728238321Z [2024-07-04T02:47:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96463999-c017-4fa1-9a37-b080ac2edc72 2024-07-04T02:47:04.635717691Z [2024-07-04T02:47:04.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:47:04.636055366Z [2024-07-04T02:47:04.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:46:00+00:00, run_id=scheduled__2024-07-04T02:46:00+00:00, run_start_date=2024-07-04 02:47:00.368418+00:00, run_end_date=2024-07-04 02:47:04.635565+00:00, run_duration=4.267147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:46:00+00:00, data_interval_end=2024-07-04 02:47:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:47:04.646327156Z [2024-07-04T02:47:04.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:47:00+00:00, run_after=2024-07-04T02:48:00+00:00 2024-07-04T02:47:04.652756360Z [2024-07-04T02:47:04.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:47:04.653034897Z [2024-07-04T02:47:04.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:46:00+00:00, run_id=scheduled__2024-07-04T02:46:00+00:00, run_start_date=2024-07-04 02:47:00.366589+00:00, run_end_date=2024-07-04 02:47:04.652597+00:00, run_duration=4.286008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:46:00+00:00, data_interval_end=2024-07-04 02:47:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:47:04.662943717Z [2024-07-04T02:47:04.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:47:00+00:00, run_after=2024-07-04T02:48:00+00:00 2024-07-04T02:47:04.709230442Z [2024-07-04T02:47:04.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:46:00+00:00 exited with status success for try_number 1 2024-07-04T02:47:04.709364853Z [2024-07-04T02:47:04.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:46:00+00:00 exited with status success for try_number 1 2024-07-04T02:47:04.725416561Z [2024-07-04T02:47:04.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:46:00+00:00, map_index=-1, run_start_date=2024-07-04 02:47:02.301804+00:00, run_end_date=2024-07-04 02:47:03.887801+00:00, run_duration=1.585997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:47:00.420667+00:00, queued_by_job_id=2, pid=6418 2024-07-04T02:47:04.725438810Z [2024-07-04T02:47:04.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:46:00+00:00, map_index=-1, run_start_date=2024-07-04 02:47:02.327182+00:00, run_end_date=2024-07-04 02:47:03.654035+00:00, run_duration=1.326853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:47:00.420667+00:00, queued_by_job_id=2, pid=6419 2024-07-04T02:47:39.636797713Z [2024-07-04T02:47:39.636+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:47:39.636826684Z 2024-07-04T02:47:39.636875967Z [2024-07-04T02:47:39.636+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-07-04T02:47:39.637632068Z [2024-07-04T02:47:39.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:47:39.637637822Z 2024-07-04T02:47:39.643182306Z [2024-07-04T02:47:39.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240704024738_084940', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:47:39.643412891Z [2024-07-04T02:47:39.643+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240704024738_084940', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-07-04T02:47:39.787654437Z [2024-07-04T02:47:39.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240704024738_084940 exited with status queued for try_number 1 2024-07-04T02:47:39.812650853Z [2024-07-04T02:47:39.810+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5aee7d3-d453-4c46-ae4d-b694d79bf65d 2024-07-04T02:47:41.416311903Z [2024-07-04T02:47:41.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:47:41.416717716Z [2024-07-04T02:47:41.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-07-04 02:47:38.889562+00:00, run_id=vdu_down_20240704024738_084940, run_start_date=2024-07-04 02:47:39.574716+00:00, run_end_date=2024-07-04 02:47:41.415976+00:00, run_duration=1.84126, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-07-04 02:47:38.889562+00:00, data_interval_end=2024-07-04 02:47:38.889562+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-07-04T02:47:41.423408985Z [2024-07-04T02:47:41.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-07-04T02:47:41.487949663Z [2024-07-04T02:47:41.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240704024738_084940 exited with status success for try_number 1 2024-07-04T02:47:41.504809942Z [2024-07-04T02:47:41.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240704024738_084940, map_index=-1, run_start_date=2024-07-04 02:47:40.534832+00:00, run_end_date=2024-07-04 02:47:40.982969+00:00, run_duration=0.448137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:47:39.638133+00:00, queued_by_job_id=2, pid=6439 2024-07-04T02:48:00.731478250Z [2024-07-04T02:48:00.730+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:48:00.764430376Z [2024-07-04T02:48:00.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:48:00+00:00, run_after=2024-07-04T02:49:00+00:00 2024-07-04T02:48:00.774180569Z [2024-07-04T02:48:00.773+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:48:00.844958213Z [2024-07-04T02:48:00.844+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:48:00.844987248Z 2024-07-04T02:48:00.844993663Z 2024-07-04T02:48:00.844996872Z 2024-07-04T02:48:00.845001714Z [2024-07-04T02:48:00.844+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:48:00.845101053Z [2024-07-04T02:48:00.844+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:48:00.845211029Z [2024-07-04T02:48:00.845+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:48:00.845812956Z [2024-07-04T02:48:00.845+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:48:00.845822683Z 2024-07-04T02:48:00.845827339Z 2024-07-04T02:48:00.845831365Z 2024-07-04T02:48:00.848913178Z [2024-07-04T02:48:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:48:00.849038626Z [2024-07-04T02:48:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:48:00.849252393Z [2024-07-04T02:48:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:48:00.849357083Z [2024-07-04T02:48:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:48:00.849643429Z [2024-07-04T02:48:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:48:00.849790525Z [2024-07-04T02:48:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:48:01.227450269Z [2024-07-04T02:48:01.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:46:00+00:00 exited with status queued for try_number 1 2024-07-04T02:48:01.227478483Z [2024-07-04T02:48:01.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:47:00+00:00 exited with status queued for try_number 1 2024-07-04T02:48:01.229456202Z [2024-07-04T02:48:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:47:00+00:00 exited with status queued for try_number 1 2024-07-04T02:48:01.238387187Z [2024-07-04T02:48:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9da0d3e-7084-40e3-8f8a-82273b56280c 2024-07-04T02:48:01.238482259Z [2024-07-04T02:48:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to d81cdf10-8e00-4377-8374-e7f77fa93058 2024-07-04T02:48:01.238680180Z [2024-07-04T02:48:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ca6ee21-c585-4051-9410-c1f325cda1d2 2024-07-04T02:48:02.897458147Z [2024-07-04T02:48:02.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:48:02.898394364Z [2024-07-04T02:48:02.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:46:00+00:00, run_id=scheduled__2024-07-04T02:46:00+00:00, run_start_date=2024-07-04 02:48:00.787957+00:00, run_end_date=2024-07-04 02:48:02.897804+00:00, run_duration=2.109847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:46:00+00:00, data_interval_end=2024-07-04 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:48:02.909410570Z [2024-07-04T02:48:02.909+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:48:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:48:02.999782621Z [2024-07-04T02:48:02.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:46:00+00:00 exited with status success for try_number 1 2024-07-04T02:48:03.013298116Z [2024-07-04T02:48:03.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:46:00+00:00, map_index=-1, run_start_date=2024-07-04 02:48:01.656354+00:00, run_end_date=2024-07-04 02:48:02.107574+00:00, run_duration=0.45122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:48:00.846533+00:00, queued_by_job_id=2, pid=6466 2024-07-04T02:48:05.180657991Z [2024-07-04T02:48:05.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:48:05.181057591Z [2024-07-04T02:48:05.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:47:00+00:00, run_id=scheduled__2024-07-04T02:47:00+00:00, run_start_date=2024-07-04 02:48:00.789301+00:00, run_end_date=2024-07-04 02:48:05.180568+00:00, run_duration=4.391267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:47:00+00:00, data_interval_end=2024-07-04 02:48:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:48:05.192385093Z [2024-07-04T02:48:05.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:48:00+00:00, run_after=2024-07-04T02:49:00+00:00 2024-07-04T02:48:05.201331101Z [2024-07-04T02:48:05.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:48:05.201876601Z [2024-07-04T02:48:05.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:47:00+00:00, run_id=scheduled__2024-07-04T02:47:00+00:00, run_start_date=2024-07-04 02:48:00.790438+00:00, run_end_date=2024-07-04 02:48:05.201463+00:00, run_duration=4.411025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:47:00+00:00, data_interval_end=2024-07-04 02:48:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:48:05.217708905Z [2024-07-04T02:48:05.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:48:00+00:00, run_after=2024-07-04T02:49:00+00:00 2024-07-04T02:48:05.257310238Z [2024-07-04T02:48:05.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:47:00+00:00 exited with status success for try_number 1 2024-07-04T02:48:05.257625150Z [2024-07-04T02:48:05.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:47:00+00:00 exited with status success for try_number 1 2024-07-04T02:48:05.275312291Z [2024-07-04T02:48:05.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:47:00+00:00, map_index=-1, run_start_date=2024-07-04 02:48:02.915183+00:00, run_end_date=2024-07-04 02:48:04.666603+00:00, run_duration=1.75142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:48:00.846533+00:00, queued_by_job_id=2, pid=6496 2024-07-04T02:48:05.275967585Z [2024-07-04T02:48:05.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:47:00+00:00, map_index=-1, run_start_date=2024-07-04 02:48:02.748786+00:00, run_end_date=2024-07-04 02:48:04.416339+00:00, run_duration=1.667553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:48:00.846533+00:00, queued_by_job_id=2, pid=6495 2024-07-04T02:49:01.005617577Z [2024-07-04T02:49:01.004+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:49:01.026142755Z [2024-07-04T02:49:01.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:49:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:49:01.094483949Z [2024-07-04T02:49:01.094+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:49:01.094516418Z 2024-07-04T02:49:01.094520979Z 2024-07-04T02:49:01.094801543Z [2024-07-04T02:49:01.094+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:49:01.095055282Z [2024-07-04T02:49:01.094+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:49:01.095912390Z [2024-07-04T02:49:01.095+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:49:01.095930329Z 2024-07-04T02:49:01.095960392Z 2024-07-04T02:49:01.102495757Z [2024-07-04T02:49:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:49:01.103026581Z [2024-07-04T02:49:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:49:01.103545328Z [2024-07-04T02:49:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:49:01.103861243Z [2024-07-04T02:49:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:49:01.282194458Z [2024-07-04T02:49:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status queued for try_number 1 2024-07-04T02:49:01.282479078Z [2024-07-04T02:49:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status queued for try_number 1 2024-07-04T02:49:01.289426888Z [2024-07-04T02:49:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd209984-3133-4403-a5eb-1d23c20e24a6 2024-07-04T02:49:01.289656484Z [2024-07-04T02:49:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7fda0af-c319-4a46-a20a-1734fe2a781b 2024-07-04T02:49:05.023889555Z [2024-07-04T02:49:05.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status success for try_number 1 2024-07-04T02:49:05.031152131Z [2024-07-04T02:49:05.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:48:00+00:00, map_index=-1, run_start_date=2024-07-04 02:49:02.974818+00:00, run_end_date=2024-07-04 02:49:04.881728+00:00, run_duration=1.90691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:49:01.097184+00:00, queued_by_job_id=2, pid=6549 2024-07-04T02:49:06.098314891Z [2024-07-04T02:49:06.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:49:06.098942625Z [2024-07-04T02:49:06.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:48:00+00:00, run_id=scheduled__2024-07-04T02:48:00+00:00, run_start_date=2024-07-04 02:49:01.041805+00:00, run_end_date=2024-07-04 02:49:06.098210+00:00, run_duration=5.056405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:48:00+00:00, data_interval_end=2024-07-04 02:49:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:49:06.112937993Z [2024-07-04T02:49:06.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:49:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:49:06.120436430Z [2024-07-04T02:49:06.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:49:06.121090593Z [2024-07-04T02:49:06.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:48:00+00:00, run_id=scheduled__2024-07-04T02:48:00+00:00, run_start_date=2024-07-04 02:49:01.043850+00:00, run_end_date=2024-07-04 02:49:06.120379+00:00, run_duration=5.076529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:48:00+00:00, data_interval_end=2024-07-04 02:49:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:49:06.133407962Z [2024-07-04T02:49:06.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:49:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:49:06.179750502Z [2024-07-04T02:49:06.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status success for try_number 1 2024-07-04T02:49:06.187862941Z [2024-07-04T02:49:06.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:48:00+00:00, map_index=-1, run_start_date=2024-07-04 02:49:03.005999+00:00, run_end_date=2024-07-04 02:49:05.368118+00:00, run_duration=2.362119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:49:01.097184+00:00, queued_by_job_id=2, pid=6550 2024-07-04T02:49:23.093386470Z [2024-07-04T02:49:23.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:49:23.162997329Z [2024-07-04T02:49:23.162+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:49:23.163046861Z 2024-07-04T02:49:23.163101449Z [2024-07-04T02:49:23.162+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:49:23.164221752Z [2024-07-04T02:49:23.163+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:49:23.164252740Z 2024-07-04T02:49:23.169139426Z [2024-07-04T02:49:23.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:49:23.169391721Z [2024-07-04T02:49:23.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:49:23.249377791Z [2024-07-04T02:49:23.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status queued for try_number 1 2024-07-04T02:49:23.259842267Z [2024-07-04T02:49:23.259+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1109ba17-548b-4e87-acea-7442f011d96a 2024-07-04T02:49:26.520672298Z [2024-07-04T02:49:26.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:49:26.521084106Z [2024-07-04T02:49:26.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc, execution_date=2024-07-04 02:48:00+00:00, run_id=scheduled__2024-07-04T02:48:00+00:00, run_start_date=2024-07-04 02:49:23.107685+00:00, run_end_date=2024-07-04 02:49:26.520557+00:00, run_duration=3.412872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:48:00+00:00, data_interval_end=2024-07-04 02:49:00+00:00, dag_hash=0bbf64191142c200eb84d266ddd952c4 2024-07-04T02:49:26.543398969Z [2024-07-04T02:49:26.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:49:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:49:26.585018004Z [2024-07-04T02:49:26.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status success for try_number 1 2024-07-04T02:49:26.591912025Z [2024-07-04T02:49:26.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:48:00+00:00, map_index=-1, run_start_date=2024-07-04 02:49:24.819102+00:00, run_end_date=2024-07-04 02:49:26.359834+00:00, run_duration=1.540732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:49:23.165597+00:00, queued_by_job_id=2, pid=6579 2024-07-04T02:49:29.400922119Z [2024-07-04T02:49:29.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:45:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:49:29.469854427Z [2024-07-04T02:49:29.469+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:49:29.469882101Z 2024-07-04T02:49:29.470255798Z [2024-07-04T02:49:29.469+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:49:29.471251410Z [2024-07-04T02:49:29.470+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:49:29.471259343Z 2024-07-04T02:49:29.475137802Z [2024-07-04T02:49:29.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:49:29.475365221Z [2024-07-04T02:49:29.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:49:29.654191325Z [2024-07-04T02:49:29.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:49:29.687037943Z [2024-07-04T02:49:29.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to adbec57e-886e-4734-b228-05d68e9b5a83 2024-07-04T02:49:31.213718433Z [2024-07-04T02:49:31.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:49:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:49:31.273551803Z [2024-07-04T02:49:31.272+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:49:31.273578386Z 2024-07-04T02:49:31.273850607Z [2024-07-04T02:49:31.273+0000] {scheduler_job.py:425} INFO - DAG vim_status_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:49:31.274831227Z [2024-07-04T02:49:31.274+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:49:31.274845006Z 2024-07-04T02:49:31.277443085Z [2024-07-04T02:49:31.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_34858745-d98b-4cab-9dea-63242887bdfc', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:49:31.277735946Z [2024-07-04T02:49:31.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:49:31.349991362Z [2024-07-04T02:49:31.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_34858745-d98b-4cab-9dea-63242887bdfc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status queued for try_number 1 2024-07-04T02:49:31.362498334Z [2024-07-04T02:49:31.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a00c2ef-80d1-4d04-83a7-9643a3f4c774 2024-07-04T02:49:32.502857911Z [2024-07-04T02:49:32.502+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:49:32.502917470Z 2024-07-04T02:49:32.503169451Z [2024-07-04T02:49:32.502+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:49:32.503864556Z [2024-07-04T02:49:32.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:49:32.503872108Z 2024-07-04T02:49:32.506934947Z [2024-07-04T02:49:32.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', task_id='split_metrics', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:49:32.507169762Z [2024-07-04T02:49:32.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'split_metrics', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:49:32.580565897Z [2024-07-04T02:49:32.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.split_metrics run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:49:32.580859478Z [2024-07-04T02:49:32.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:49:32.592678891Z [2024-07-04T02:49:32.592+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=-1, run_start_date=2024-07-04 02:49:31.711329+00:00, run_end_date=2024-07-04 02:49:32.118245+00:00, run_duration=0.406916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:49:29.471898+00:00, queued_by_job_id=2, pid=6601 2024-07-04T02:49:32.592994681Z [2024-07-04T02:49:32.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08c54cd4-a4a7-45ca-affc-592a76fc1d85 2024-07-04T02:49:34.486963081Z [2024-07-04T02:49:34.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:49:34.487287850Z [2024-07-04T02:49:34.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_34858745-d98b-4cab-9dea-63242887bdfc, execution_date=2024-07-04 02:48:00+00:00, run_id=scheduled__2024-07-04T02:48:00+00:00, run_start_date=2024-07-04 02:49:31.224203+00:00, run_end_date=2024-07-04 02:49:34.486796+00:00, run_duration=3.262593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:48:00+00:00, data_interval_end=2024-07-04 02:49:00+00:00, dag_hash=9524bee44a2a0701445ebc7c9b5a1e2d 2024-07-04T02:49:34.499309668Z [2024-07-04T02:49:34.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:49:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:49:34.575736229Z [2024-07-04T02:49:34.575+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:49:34.575776755Z 2024-07-04T02:49:34.575871671Z [2024-07-04T02:49:34.575+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:49:34.576723564Z [2024-07-04T02:49:34.576+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:49:34.576736354Z 2024-07-04T02:49:34.579969333Z [2024-07-04T02:49:34.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:49:34.580289544Z [2024-07-04T02:49:34.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'collect_metrics', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:49:34.636335575Z [2024-07-04T02:49:34.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.collect_metrics run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:49:34.636481012Z [2024-07-04T02:49:34.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_34858745-d98b-4cab-9dea-63242887bdfc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status success for try_number 1 2024-07-04T02:49:34.642155923Z [2024-07-04T02:49:34.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:48:00+00:00, map_index=-1, run_start_date=2024-07-04 02:49:32.927588+00:00, run_end_date=2024-07-04 02:49:34.256182+00:00, run_duration=1.328594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:49:31.275337+00:00, queued_by_job_id=2, pid=6622 2024-07-04T02:49:34.642415175Z [2024-07-04T02:49:34.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a69d168-a99b-4649-a0dd-d304dd7f255d 2024-07-04T02:49:34.730422765Z [2024-07-04T02:49:34.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.split_metrics run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:49:34.740897637Z [2024-07-04T02:49:34.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=split_metrics, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=-1, run_start_date=2024-07-04 02:49:34.075235+00:00, run_end_date=2024-07-04 02:49:34.447025+00:00, run_duration=0.37179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:49:32.504347+00:00, queued_by_job_id=2, pid=6642 2024-07-04T02:49:36.905302513Z [2024-07-04T02:49:36.904+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:49:36.905353522Z 2024-07-04T02:49:36.905496667Z [2024-07-04T02:49:36.905+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:49:36.906209530Z [2024-07-04T02:49:36.905+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:49:36.906224182Z 2024-07-04T02:49:36.908429710Z [2024-07-04T02:49:36.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:49:36.908659195Z [2024-07-04T02:49:36.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'send_prometheus', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:49:36.976294824Z [2024-07-04T02:49:36.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.send_prometheus run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status queued for try_number 1 2024-07-04T02:49:36.976840920Z [2024-07-04T02:49:36.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.collect_metrics run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:49:36.988157590Z [2024-07-04T02:49:36.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=0, run_start_date=2024-07-04 02:49:36.147548+00:00, run_end_date=2024-07-04 02:49:36.529611+00:00, run_duration=0.382063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:49:34.577271+00:00, queued_by_job_id=2, pid=6652 2024-07-04T02:49:36.988343023Z [2024-07-04T02:49:36.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6865f15-8d2f-4179-ad40-be4a8785e7ba 2024-07-04T02:49:39.654357076Z [2024-07-04T02:49:39.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:49:39.654630369Z [2024-07-04T02:49:39.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, execution_date=2024-07-04 02:40:00+00:00, run_id=scheduled__2024-07-04T02:40:00+00:00, run_start_date=2024-07-04 02:49:29.415566+00:00, run_end_date=2024-07-04 02:49:39.654330+00:00, run_duration=10.238764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:40:00+00:00, data_interval_end=2024-07-04 02:45:00+00:00, dag_hash=6c8eb2a6f907d1224e1d69d89935891c 2024-07-04T02:49:39.666807287Z [2024-07-04T02:49:39.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:45:00+00:00, run_after=2024-07-04T02:50:00+00:00 2024-07-04T02:49:39.694608119Z [2024-07-04T02:49:39.694+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:49:39.694633841Z 2024-07-04T02:49:39.694999539Z [2024-07-04T02:49:39.694+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-07-04T02:49:39.695715465Z [2024-07-04T02:49:39.695+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:49:39.695733181Z 2024-07-04T02:49:39.698147829Z [2024-07-04T02:49:39.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240704024938_675020', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:49:39.698220227Z [2024-07-04T02:49:39.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240704024938_675020', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-07-04T02:49:39.778174972Z [2024-07-04T02:49:39.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240704024938_675020 exited with status queued for try_number 1 2024-07-04T02:49:39.778224903Z [2024-07-04T02:49:39.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.send_prometheus run_id=scheduled__2024-07-04T02:40:00+00:00 exited with status success for try_number 1 2024-07-04T02:49:39.786685216Z [2024-07-04T02:49:39.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82c70984-8ae2-4ccc-8f60-a5d218039da5 2024-07-04T02:49:39.786774718Z [2024-07-04T02:49:39.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:40:00+00:00, map_index=-1, run_start_date=2024-07-04 02:49:38.621958+00:00, run_end_date=2024-07-04 02:49:38.959114+00:00, run_duration=0.337156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:49:36.906619+00:00, queued_by_job_id=2, pid=6664 2024-07-04T02:49:40.963097935Z [2024-07-04T02:49:40.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:49:40.963368957Z [2024-07-04T02:49:40.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-07-04 02:49:38.894087+00:00, run_id=vdu_down_20240704024938_675020, run_start_date=2024-07-04 02:49:39.592991+00:00, run_end_date=2024-07-04 02:49:40.963094+00:00, run_duration=1.370103, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-07-04 02:49:38.894087+00:00, data_interval_end=2024-07-04 02:49:38.894087+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-07-04T02:49:40.966366625Z [2024-07-04T02:49:40.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-07-04T02:49:41.014954884Z [2024-07-04T02:49:41.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240704024938_675020 exited with status success for try_number 1 2024-07-04T02:49:41.022379695Z [2024-07-04T02:49:41.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240704024938_675020, map_index=-1, run_start_date=2024-07-04 02:49:40.376075+00:00, run_end_date=2024-07-04 02:49:40.761403+00:00, run_duration=0.385328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:49:39.695691+00:00, queued_by_job_id=2, pid=6666 2024-07-04T02:50:00.101827422Z [2024-07-04T02:50:00.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:55:00+00:00 2024-07-04T02:50:00.121203179Z [2024-07-04T02:50:00.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:55:00+00:00 2024-07-04T02:50:00.152770904Z [2024-07-04T02:50:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:51:00+00:00 2024-07-04T02:50:00.164498648Z [2024-07-04T02:50:00.163+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:50:00.178896232Z [2024-07-04T02:50:00.178+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:50:00.190891158Z [2024-07-04T02:50:00.190+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:50:00.205520946Z [2024-07-04T02:50:00.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:51:00+00:00 2024-07-04T02:50:00.333711440Z [2024-07-04T02:50:00.333+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-07-04T02:50:00.333737203Z 2024-07-04T02:50:00.333740946Z 2024-07-04T02:50:00.333744190Z 2024-07-04T02:50:00.333748015Z 2024-07-04T02:50:00.333751376Z 2024-07-04T02:50:00.333754964Z 2024-07-04T02:50:00.333791881Z 2024-07-04T02:50:00.333807054Z [2024-07-04T02:50:00.333+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:50:00.333992582Z [2024-07-04T02:50:00.333+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:50:00.334087637Z [2024-07-04T02:50:00.333+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:50:00.334253392Z [2024-07-04T02:50:00.334+0000] {scheduler_job.py:425} INFO - DAG vim_status_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:50:00.334347325Z [2024-07-04T02:50:00.334+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:50:00.334444777Z [2024-07-04T02:50:00.334+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:50:00.334529443Z [2024-07-04T02:50:00.334+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:50:00.335203747Z [2024-07-04T02:50:00.335+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:50:00.335215324Z 2024-07-04T02:50:00.335218606Z 2024-07-04T02:50:00.335222387Z 2024-07-04T02:50:00.335231202Z 2024-07-04T02:50:00.335234586Z 2024-07-04T02:50:00.335237921Z 2024-07-04T02:50:00.335241217Z 2024-07-04T02:50:00.339652525Z [2024-07-04T02:50:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:50:00.339838702Z [2024-07-04T02:50:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:00.340127918Z [2024-07-04T02:50:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:50:00.340281943Z [2024-07-04T02:50:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:00.340578052Z [2024-07-04T02:50:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:50:00.340706535Z [2024-07-04T02:50:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:50:00.340874771Z [2024-07-04T02:50:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_34858745-d98b-4cab-9dea-63242887bdfc', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:50:00.340984938Z [2024-07-04T02:50:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:50:00.341179970Z [2024-07-04T02:50:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:50:00.341353901Z [2024-07-04T02:50:00.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:50:00.341584487Z [2024-07-04T02:50:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:50:00.341754772Z [2024-07-04T02:50:00.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:50:00.341997548Z [2024-07-04T02:50:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:50:00.342152178Z [2024-07-04T02:50:00.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:50:01.592219999Z [2024-07-04T02:50:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:01.592251620Z [2024-07-04T02:50:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:01.592287614Z [2024-07-04T02:50:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:01.592434539Z [2024-07-04T02:50:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_34858745-d98b-4cab-9dea-63242887bdfc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:01.592598341Z [2024-07-04T02:50:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:01.592723566Z [2024-07-04T02:50:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:01.592841039Z [2024-07-04T02:50:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:01.612951596Z [2024-07-04T02:50:01.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d71e7d2-4312-4755-a94f-ae603201765a 2024-07-04T02:50:01.613238336Z [2024-07-04T02:50:01.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to b714d869-5b6d-4e3f-88cc-272f6ec652d0 2024-07-04T02:50:01.613288743Z [2024-07-04T02:50:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7138d0a4-1568-4645-88cd-13c4a39cfd84 2024-07-04T02:50:01.613473165Z [2024-07-04T02:50:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 486bad40-b766-4a67-9957-93ae1daac0e0 2024-07-04T02:50:01.613633608Z [2024-07-04T02:50:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87b67594-af08-46ea-bc39-7797dfef469a 2024-07-04T02:50:01.613804851Z [2024-07-04T02:50:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fdd6d6b-fc0b-4026-83b5-53735951d6ad 2024-07-04T02:50:01.614006247Z [2024-07-04T02:50:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 929e9b72-9fc9-45c2-880a-2d3791f7e50d 2024-07-04T02:50:04.416615153Z [2024-07-04T02:50:04.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:48:00+00:00 exited with status success for try_number 1 2024-07-04T02:50:04.440106517Z [2024-07-04T02:50:04.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:48:00+00:00, map_index=-1, run_start_date=2024-07-04 02:50:03.069410+00:00, run_end_date=2024-07-04 02:50:04.187712+00:00, run_duration=1.118302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:00.336551+00:00, queued_by_job_id=2, pid=6696 2024-07-04T02:50:05.684135410Z [2024-07-04T02:50:05.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:50:05.684455365Z [2024-07-04T02:50:05.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:48:00+00:00, run_id=scheduled__2024-07-04T02:48:00+00:00, run_start_date=2024-07-04 02:50:00.223553+00:00, run_end_date=2024-07-04 02:50:05.684083+00:00, run_duration=5.46053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:48:00+00:00, data_interval_end=2024-07-04 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:50:05.713799987Z [2024-07-04T02:50:05.713+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:52:00+00:00 2024-07-04T02:50:08.297601930Z [2024-07-04T02:50:08.297+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:50:08.297631694Z 2024-07-04T02:50:08.297763460Z [2024-07-04T02:50:08.297+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:50:08.298711483Z [2024-07-04T02:50:08.298+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:50:08.298725779Z 2024-07-04T02:50:08.303113105Z [2024-07-04T02:50:08.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:50:08.303539401Z [2024-07-04T02:50:08.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:08.369167663Z [2024-07-04T02:50:08.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:08.370626775Z [2024-07-04T02:50:08.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status success for try_number 1 2024-07-04T02:50:08.370826921Z [2024-07-04T02:50:08.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status failed for try_number 1 2024-07-04T02:50:08.371040774Z [2024-07-04T02:50:08.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_34858745-d98b-4cab-9dea-63242887bdfc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status failed for try_number 1 2024-07-04T02:50:08.371277892Z [2024-07-04T02:50:08.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status failed for try_number 1 2024-07-04T02:50:08.391695508Z [2024-07-04T02:50:08.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:45:00+00:00, map_index=-1, run_start_date=2024-07-04 02:50:07.517887+00:00, run_end_date=2024-07-04 02:50:07.859383+00:00, run_duration=0.341496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:00.336551+00:00, queued_by_job_id=2, pid=6799 2024-07-04T02:50:08.393034750Z [2024-07-04T02:50:08.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc03c2b9-f196-466b-bde0-a4d8362ff90c 2024-07-04T02:50:08.393349069Z [2024-07-04T02:50:08.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:45:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:00.336551+00:00, queued_by_job_id=2, pid=None 2024-07-04T02:50:08.393912449Z [2024-07-04T02:50:08.393+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:08.398953323Z [2024-07-04T02:50:08.398+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:08.416644397Z [2024-07-04T02:50:08.416+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=extract_metrics_from_vnfrs, execution_date=20240704T024500, start_date=, end_date=20240704T025008 2024-07-04T02:50:08.428724070Z [2024-07-04T02:50:08.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:49:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:00.336551+00:00, queued_by_job_id=2, pid=None 2024-07-04T02:50:08.429901231Z [2024-07-04T02:50:08.429+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:08.433162041Z [2024-07-04T02:50:08.432+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:08.455678880Z [2024-07-04T02:50:08.455+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T024900, start_date=, end_date=20240704T025008 2024-07-04T02:50:08.468022447Z [2024-07-04T02:50:08.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:49:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:00.336551+00:00, queued_by_job_id=2, pid=None 2024-07-04T02:50:08.468788634Z [2024-07-04T02:50:08.468+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:08.471800457Z [2024-07-04T02:50:08.471+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:08.500396921Z [2024-07-04T02:50:08.499+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T024900, start_date=, end_date=20240704T025008 2024-07-04T02:50:08.576551719Z [2024-07-04T02:50:08.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:50:08.577556159Z [2024-07-04T02:50:08.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:49:00+00:00, run_id=scheduled__2024-07-04T02:49:00+00:00, run_start_date=2024-07-04 02:50:00.224913+00:00, run_end_date=2024-07-04 02:50:08.576465+00:00, run_duration=8.351552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:49:00+00:00, data_interval_end=2024-07-04 02:50:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:50:08.594680468Z [2024-07-04T02:50:08.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:51:00+00:00 2024-07-04T02:50:08.770566268Z [2024-07-04T02:50:08.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status success for try_number 1 2024-07-04T02:50:08.780000548Z [2024-07-04T02:50:08.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:49:00+00:00, map_index=-1, run_start_date=2024-07-04 02:50:06.692974+00:00, run_end_date=2024-07-04 02:50:08.244209+00:00, run_duration=1.551235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:00.336551+00:00, queued_by_job_id=2, pid=6720 2024-07-04T02:50:09.598949182Z [2024-07-04T02:50:09.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:50:09.598971622Z [2024-07-04T02:50:09.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:49:00+00:00, run_id=scheduled__2024-07-04T02:49:00+00:00, run_start_date=2024-07-04 02:50:00.226181+00:00, run_end_date=2024-07-04 02:50:09.594324+00:00, run_duration=9.368143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:49:00+00:00, data_interval_end=2024-07-04 02:50:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:50:09.610936135Z [2024-07-04T02:50:09.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:51:00+00:00 2024-07-04T02:50:09.693877678Z [2024-07-04T02:50:09.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status success for try_number 1 2024-07-04T02:50:09.712959798Z [2024-07-04T02:50:09.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:49:00+00:00, map_index=-1, run_start_date=2024-07-04 02:50:07.281447+00:00, run_end_date=2024-07-04 02:50:08.929550+00:00, run_duration=1.648103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:00.336551+00:00, queued_by_job_id=2, pid=6784 2024-07-04T02:50:12.063695752Z [2024-07-04T02:50:12.063+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:50:12.063730524Z 2024-07-04T02:50:12.063743379Z [2024-07-04T02:50:12.063+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:50:12.064882706Z [2024-07-04T02:50:12.064+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:50:12.064908951Z 2024-07-04T02:50:12.067433678Z [2024-07-04T02:50:12.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:50:12.067686648Z [2024-07-04T02:50:12.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:50:12.134261199Z [2024-07-04T02:50:12.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:12.134352852Z [2024-07-04T02:50:12.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status success for try_number 1 2024-07-04T02:50:12.142699302Z [2024-07-04T02:50:12.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6643749-e53a-4bf4-81d6-9116b0885cff 2024-07-04T02:50:12.142906526Z [2024-07-04T02:50:12.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:45:00+00:00, map_index=-1, run_start_date=2024-07-04 02:50:10.639674+00:00, run_end_date=2024-07-04 02:50:11.045906+00:00, run_duration=0.406232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:08.299252+00:00, queued_by_job_id=2, pid=6833 2024-07-04T02:50:14.554759539Z [2024-07-04T02:50:14.554+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:50:14.554809216Z 2024-07-04T02:50:14.554831127Z [2024-07-04T02:50:14.554+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:50:14.555308233Z [2024-07-04T02:50:14.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:50:14.555325648Z 2024-07-04T02:50:14.557671986Z [2024-07-04T02:50:14.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:50:14.557701244Z [2024-07-04T02:50:14.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:14.626445874Z [2024-07-04T02:50:14.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status queued for try_number 1 2024-07-04T02:50:14.627062140Z [2024-07-04T02:50:14.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status success for try_number 1 2024-07-04T02:50:14.636017008Z [2024-07-04T02:50:14.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8374d039-938c-458a-8a97-3fc11e1f8207 2024-07-04T02:50:14.636553357Z [2024-07-04T02:50:14.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:45:00+00:00, map_index=0, run_start_date=2024-07-04 02:50:13.863997+00:00, run_end_date=2024-07-04 02:50:14.249300+00:00, run_duration=0.385303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:12.065256+00:00, queued_by_job_id=2, pid=6845 2024-07-04T02:50:17.836330516Z [2024-07-04T02:50:17.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:50:17.836590639Z [2024-07-04T02:50:17.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:45:00+00:00, run_id=scheduled__2024-07-04T02:45:00+00:00, run_start_date=2024-07-04 02:50:00.222206+00:00, run_end_date=2024-07-04 02:50:17.836180+00:00, run_duration=17.613974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:45:00+00:00, data_interval_end=2024-07-04 02:50:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:50:17.844059568Z [2024-07-04T02:50:17.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:55:00+00:00 2024-07-04T02:50:17.941322219Z [2024-07-04T02:50:17.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status success for try_number 1 2024-07-04T02:50:17.956005713Z [2024-07-04T02:50:17.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:45:00+00:00, map_index=-1, run_start_date=2024-07-04 02:50:16.249653+00:00, run_end_date=2024-07-04 02:50:16.691977+00:00, run_duration=0.442324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:14.555561+00:00, queued_by_job_id=2, pid=6857 2024-07-04T02:50:19.090408037Z [2024-07-04T02:50:19.089+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:50:19.090449174Z 2024-07-04T02:50:19.090453593Z 2024-07-04T02:50:19.090457493Z 2024-07-04T02:50:19.090726012Z [2024-07-04T02:50:19.090+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:50:19.090969621Z [2024-07-04T02:50:19.090+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:50:19.091221548Z [2024-07-04T02:50:19.091+0000] {scheduler_job.py:425} INFO - DAG vim_status_34858745-d98b-4cab-9dea-63242887bdfc has 0/16 running and queued tasks 2024-07-04T02:50:19.092482448Z [2024-07-04T02:50:19.092+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:50:19.092515773Z 2024-07-04T02:50:19.092524812Z 2024-07-04T02:50:19.092532687Z 2024-07-04T02:50:19.099880077Z [2024-07-04T02:50:19.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:45:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:50:19.100254502Z [2024-07-04T02:50:19.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:19.100730028Z [2024-07-04T02:50:19.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:49:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:50:19.100957518Z [2024-07-04T02:50:19.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:50:19.101471127Z [2024-07-04T02:50:19.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_34858745-d98b-4cab-9dea-63242887bdfc', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:49:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:50:19.101854617Z [2024-07-04T02:50:19.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:50:19.464011965Z [2024-07-04T02:50:19.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status queued for try_number 2 2024-07-04T02:50:19.465460312Z [2024-07-04T02:50:19.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status queued for try_number 2 2024-07-04T02:50:19.469679788Z [2024-07-04T02:50:19.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_34858745-d98b-4cab-9dea-63242887bdfc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status queued for try_number 2 2024-07-04T02:50:19.497794253Z [2024-07-04T02:50:19.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4887adf1-41e0-4cd3-a6ec-aa8835f505ce 2024-07-04T02:50:19.499857381Z [2024-07-04T02:50:19.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59d3df1e-eff3-4050-bf59-e16102e68ba8 2024-07-04T02:50:19.503880374Z [2024-07-04T02:50:19.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc498727-79f4-4fd7-af01-b3a7689678dd 2024-07-04T02:50:22.588926812Z [2024-07-04T02:50:22.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:45:00+00:00 exited with status failed for try_number 2 2024-07-04T02:50:22.589402233Z [2024-07-04T02:50:22.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status failed for try_number 2 2024-07-04T02:50:22.589854396Z [2024-07-04T02:50:22.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_34858745-d98b-4cab-9dea-63242887bdfc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:49:00+00:00 exited with status failed for try_number 2 2024-07-04T02:50:22.602447384Z [2024-07-04T02:50:22.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:49:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 02:50:08.436863+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:19.094408+00:00, queued_by_job_id=2, pid=None 2024-07-04T02:50:22.603506396Z [2024-07-04T02:50:22.603+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:22.607027294Z [2024-07-04T02:50:22.606+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:22.622984781Z [2024-07-04T02:50:22.622+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240704T024900, start_date=, end_date=20240704T025022 2024-07-04T02:50:22.629959026Z [2024-07-04T02:50:22.629+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:49:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 02:50:08.477193+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:19.094408+00:00, queued_by_job_id=2, pid=None 2024-07-04T02:50:22.630609757Z [2024-07-04T02:50:22.630+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:22.632936102Z [2024-07-04T02:50:22.632+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:22.645057521Z [2024-07-04T02:50:22.644+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240704T024900, start_date=, end_date=20240704T025022 2024-07-04T02:50:22.652041738Z [2024-07-04T02:50:22.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:45:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-07-04 02:50:08.403904+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:50:19.094408+00:00, queued_by_job_id=2, pid=None 2024-07-04T02:50:22.652607413Z [2024-07-04T02:50:22.652+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:22.654899763Z [2024-07-04T02:50:22.654+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-07-04T02:50:22.664245601Z [2024-07-04T02:50:22.663+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, task_id=extract_metrics_from_vnfrs, execution_date=20240704T024500, start_date=, end_date=20240704T025022 2024-07-04T02:50:23.517928636Z [2024-07-04T02:50:23.517+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T02:50:23.518403213Z [2024-07-04T02:50:23.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_34858745-d98b-4cab-9dea-63242887bdfc, execution_date=2024-07-04 02:49:00+00:00, run_id=scheduled__2024-07-04T02:49:00+00:00, run_start_date=2024-07-04 02:50:00.228641+00:00, run_end_date=2024-07-04 02:50:23.517808+00:00, run_duration=23.289167, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:49:00+00:00, data_interval_end=2024-07-04 02:50:00+00:00, dag_hash=9524bee44a2a0701445ebc7c9b5a1e2d 2024-07-04T02:50:23.530240960Z [2024-07-04T02:50:23.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:51:00+00:00 2024-07-04T02:50:23.538792721Z [2024-07-04T02:50:23.538+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T02:50:23.539036377Z [2024-07-04T02:50:23.538+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc, execution_date=2024-07-04 02:49:00+00:00, run_id=scheduled__2024-07-04T02:49:00+00:00, run_start_date=2024-07-04 02:50:00.227586+00:00, run_end_date=2024-07-04 02:50:23.538617+00:00, run_duration=23.311031, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:49:00+00:00, data_interval_end=2024-07-04 02:50:00+00:00, dag_hash=0bbf64191142c200eb84d266ddd952c4 2024-07-04T02:50:23.549063271Z [2024-07-04T02:50:23.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:51:00+00:00 2024-07-04T02:50:26.348412009Z [2024-07-04T02:50:26.348+0000] {dagrun.py:586} ERROR - Marking run failed 2024-07-04T02:50:26.351093897Z [2024-07-04T02:50:26.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc, execution_date=2024-07-04 02:45:00+00:00, run_id=scheduled__2024-07-04T02:45:00+00:00, run_start_date=2024-07-04 02:50:00.220434+00:00, run_end_date=2024-07-04 02:50:26.348569+00:00, run_duration=26.128135, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:45:00+00:00, data_interval_end=2024-07-04 02:50:00+00:00, dag_hash=6c8eb2a6f907d1224e1d69d89935891c 2024-07-04T02:50:26.365718359Z [2024-07-04T02:50:26.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc to 2024-07-04T02:50:00+00:00, run_after=2024-07-04T02:55:00+00:00 2024-07-04T02:51:00.787716293Z [2024-07-04T02:51:00.787+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:51:00.806427795Z [2024-07-04T02:51:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:51:00+00:00, run_after=2024-07-04T02:52:00+00:00 2024-07-04T02:51:00.870968210Z [2024-07-04T02:51:00.870+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:51:00.870996615Z 2024-07-04T02:51:00.871000642Z 2024-07-04T02:51:00.871170496Z [2024-07-04T02:51:00.870+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:51:00.871338215Z [2024-07-04T02:51:00.871+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:51:00.872011087Z [2024-07-04T02:51:00.871+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:51:00.872022677Z 2024-07-04T02:51:00.872026421Z 2024-07-04T02:51:00.875633727Z [2024-07-04T02:51:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:51:00.875879022Z [2024-07-04T02:51:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:51:00.876141656Z [2024-07-04T02:51:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:51:00.876305567Z [2024-07-04T02:51:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:51:01.089321317Z [2024-07-04T02:51:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status queued for try_number 1 2024-07-04T02:51:01.089676312Z [2024-07-04T02:51:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status queued for try_number 1 2024-07-04T02:51:01.101313759Z [2024-07-04T02:51:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to e976d592-ddc6-4406-8571-07ec4730f476 2024-07-04T02:51:01.101721558Z [2024-07-04T02:51:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to f59cbdfa-243d-41c3-8b50-51fa8cfa5796 2024-07-04T02:51:04.997291574Z [2024-07-04T02:51:04.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:51:04.997694325Z [2024-07-04T02:51:04.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:50:00+00:00, run_id=scheduled__2024-07-04T02:50:00+00:00, run_start_date=2024-07-04 02:51:00.818580+00:00, run_end_date=2024-07-04 02:51:04.997134+00:00, run_duration=4.178554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:50:00+00:00, data_interval_end=2024-07-04 02:51:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:51:05.019839409Z [2024-07-04T02:51:05.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:51:00+00:00, run_after=2024-07-04T02:52:00+00:00 2024-07-04T02:51:05.028352567Z [2024-07-04T02:51:05.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:51:05.028613795Z [2024-07-04T02:51:05.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:50:00+00:00, run_id=scheduled__2024-07-04T02:50:00+00:00, run_start_date=2024-07-04 02:51:00.817087+00:00, run_end_date=2024-07-04 02:51:05.028188+00:00, run_duration=4.211101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:50:00+00:00, data_interval_end=2024-07-04 02:51:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:51:05.038350274Z [2024-07-04T02:51:05.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:51:00+00:00, run_after=2024-07-04T02:52:00+00:00 2024-07-04T02:51:05.068244514Z [2024-07-04T02:51:05.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status success for try_number 1 2024-07-04T02:51:05.068301841Z [2024-07-04T02:51:05.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status success for try_number 1 2024-07-04T02:51:05.076269739Z [2024-07-04T02:51:05.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:50:00+00:00, map_index=-1, run_start_date=2024-07-04 02:51:02.662770+00:00, run_end_date=2024-07-04 02:51:04.297942+00:00, run_duration=1.635172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:51:00.872686+00:00, queued_by_job_id=2, pid=6953 2024-07-04T02:51:05.076325805Z [2024-07-04T02:51:05.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:50:00+00:00, map_index=-1, run_start_date=2024-07-04 02:51:02.727344+00:00, run_end_date=2024-07-04 02:51:03.991361+00:00, run_duration=1.264017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:51:00.872686+00:00, queued_by_job_id=2, pid=6954 2024-07-04T02:51:22.084017042Z [2024-07-04T02:51:22.083+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:52:00.072177068Z [2024-07-04T02:52:00.071+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:52:00.086125438Z [2024-07-04T02:52:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:52:00+00:00, run_after=2024-07-04T02:53:00+00:00 2024-07-04T02:52:00.094325613Z [2024-07-04T02:52:00.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:52:00.175313340Z [2024-07-04T02:52:00.174+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:52:00.175343104Z 2024-07-04T02:52:00.175352324Z 2024-07-04T02:52:00.175358049Z 2024-07-04T02:52:00.175998721Z [2024-07-04T02:52:00.175+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:52:00.176285654Z [2024-07-04T02:52:00.176+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:52:00.176477673Z [2024-07-04T02:52:00.176+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:52:00.177110533Z [2024-07-04T02:52:00.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:52:00.177121502Z 2024-07-04T02:52:00.177124879Z 2024-07-04T02:52:00.177127914Z 2024-07-04T02:52:00.180908417Z [2024-07-04T02:52:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:52:00.181236625Z [2024-07-04T02:52:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:52:00.181582443Z [2024-07-04T02:52:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:52:00.181718731Z [2024-07-04T02:52:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:52:00.181959080Z [2024-07-04T02:52:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:52:00.182121440Z [2024-07-04T02:52:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:52:00.660011589Z [2024-07-04T02:52:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status queued for try_number 1 2024-07-04T02:52:00.667521717Z [2024-07-04T02:52:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:51:00+00:00 exited with status queued for try_number 1 2024-07-04T02:52:00.667687903Z [2024-07-04T02:52:00.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:51:00+00:00 exited with status queued for try_number 1 2024-07-04T02:52:00.688511294Z [2024-07-04T02:52:00.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 418841cd-292d-4583-9c83-f7685161a952 2024-07-04T02:52:00.691328271Z [2024-07-04T02:52:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ec4ecaf-c49b-4320-91dc-38983388f105 2024-07-04T02:52:00.691503026Z [2024-07-04T02:52:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66833f33-b7b1-495b-a6f5-a8464832c37d 2024-07-04T02:52:03.300653939Z [2024-07-04T02:52:03.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:52:03.301104078Z [2024-07-04T02:52:03.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:50:00+00:00, run_id=scheduled__2024-07-04T02:50:00+00:00, run_start_date=2024-07-04 02:52:00.115692+00:00, run_end_date=2024-07-04 02:52:03.300463+00:00, run_duration=3.184771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:50:00+00:00, data_interval_end=2024-07-04 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:52:03.308404181Z [2024-07-04T02:52:03.308+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:52:00+00:00, run_after=2024-07-04T02:54:00+00:00 2024-07-04T02:52:03.357068728Z [2024-07-04T02:52:03.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status success for try_number 1 2024-07-04T02:52:03.363852462Z [2024-07-04T02:52:03.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:50:00+00:00, map_index=-1, run_start_date=2024-07-04 02:52:02.035785+00:00, run_end_date=2024-07-04 02:52:02.635846+00:00, run_duration=0.600061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:52:00.177783+00:00, queued_by_job_id=2, pid=6989 2024-07-04T02:52:05.479386854Z [2024-07-04T02:52:05.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:52:05.479833204Z [2024-07-04T02:52:05.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:51:00+00:00, run_id=scheduled__2024-07-04T02:51:00+00:00, run_start_date=2024-07-04 02:52:00.117182+00:00, run_end_date=2024-07-04 02:52:05.479473+00:00, run_duration=5.362291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:51:00+00:00, data_interval_end=2024-07-04 02:52:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:52:05.489909096Z [2024-07-04T02:52:05.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:52:00+00:00, run_after=2024-07-04T02:53:00+00:00 2024-07-04T02:52:05.498698242Z [2024-07-04T02:52:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:52:05.498982783Z [2024-07-04T02:52:05.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:51:00+00:00, run_id=scheduled__2024-07-04T02:51:00+00:00, run_start_date=2024-07-04 02:52:00.118604+00:00, run_end_date=2024-07-04 02:52:05.498631+00:00, run_duration=5.380027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:51:00+00:00, data_interval_end=2024-07-04 02:52:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:52:05.511410419Z [2024-07-04T02:52:05.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:52:00+00:00, run_after=2024-07-04T02:53:00+00:00 2024-07-04T02:52:05.554168631Z [2024-07-04T02:52:05.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:51:00+00:00 exited with status success for try_number 1 2024-07-04T02:52:05.554467115Z [2024-07-04T02:52:05.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:51:00+00:00 exited with status success for try_number 1 2024-07-04T02:52:05.569423312Z [2024-07-04T02:52:05.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:51:00+00:00, map_index=-1, run_start_date=2024-07-04 02:52:03.248937+00:00, run_end_date=2024-07-04 02:52:04.655170+00:00, run_duration=1.406233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:52:00.177783+00:00, queued_by_job_id=2, pid=7018 2024-07-04T02:52:05.570461983Z [2024-07-04T02:52:05.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:51:00+00:00, map_index=-1, run_start_date=2024-07-04 02:52:03.277387+00:00, run_end_date=2024-07-04 02:52:05.050779+00:00, run_duration=1.773392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:52:00.177783+00:00, queued_by_job_id=2, pid=7019 2024-07-04T02:53:00.159423368Z [2024-07-04T02:53:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:53:00+00:00, run_after=2024-07-04T02:54:00+00:00 2024-07-04T02:53:00.178227417Z [2024-07-04T02:53:00.177+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:53:00.238613546Z [2024-07-04T02:53:00.238+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:53:00.238643147Z 2024-07-04T02:53:00.238646819Z 2024-07-04T02:53:00.238650149Z [2024-07-04T02:53:00.238+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:53:00.238854604Z [2024-07-04T02:53:00.238+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:53:00.239477903Z [2024-07-04T02:53:00.239+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:53:00.239492942Z 2024-07-04T02:53:00.239496557Z 2024-07-04T02:53:00.242835710Z [2024-07-04T02:53:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:53:00.243072395Z [2024-07-04T02:53:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:53:00.243092670Z [2024-07-04T02:53:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:53:00.243267092Z [2024-07-04T02:53:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:53:00.524259728Z [2024-07-04T02:53:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:52:00+00:00 exited with status queued for try_number 1 2024-07-04T02:53:00.524291449Z [2024-07-04T02:53:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:52:00+00:00 exited with status queued for try_number 1 2024-07-04T02:53:00.532923179Z [2024-07-04T02:53:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa04fffb-07fb-45b6-bf7c-f9832e1a175b 2024-07-04T02:53:00.532950160Z [2024-07-04T02:53:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to a84a3e15-c4e7-4776-8b1e-0c1074524cbf 2024-07-04T02:53:04.247211649Z [2024-07-04T02:53:04.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:53:04.247617712Z [2024-07-04T02:53:04.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:52:00+00:00, run_id=scheduled__2024-07-04T02:52:00+00:00, run_start_date=2024-07-04 02:53:00.194609+00:00, run_end_date=2024-07-04 02:53:04.247056+00:00, run_duration=4.052447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:52:00+00:00, data_interval_end=2024-07-04 02:53:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:53:04.256702328Z [2024-07-04T02:53:04.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:53:00+00:00, run_after=2024-07-04T02:54:00+00:00 2024-07-04T02:53:04.263005650Z [2024-07-04T02:53:04.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:53:04.263349125Z [2024-07-04T02:53:04.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:52:00+00:00, run_id=scheduled__2024-07-04T02:52:00+00:00, run_start_date=2024-07-04 02:53:00.192573+00:00, run_end_date=2024-07-04 02:53:04.262842+00:00, run_duration=4.070269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:52:00+00:00, data_interval_end=2024-07-04 02:53:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:53:04.275318989Z [2024-07-04T02:53:04.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:53:00+00:00, run_after=2024-07-04T02:54:00+00:00 2024-07-04T02:53:04.306917096Z [2024-07-04T02:53:04.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:52:00+00:00 exited with status success for try_number 1 2024-07-04T02:53:04.307282948Z [2024-07-04T02:53:04.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:52:00+00:00 exited with status success for try_number 1 2024-07-04T02:53:04.313820505Z [2024-07-04T02:53:04.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:52:00+00:00, map_index=-1, run_start_date=2024-07-04 02:53:02.226390+00:00, run_end_date=2024-07-04 02:53:04.099591+00:00, run_duration=1.873201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:53:00.239912+00:00, queued_by_job_id=2, pid=7072 2024-07-04T02:53:04.314177698Z [2024-07-04T02:53:04.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:52:00+00:00, map_index=-1, run_start_date=2024-07-04 02:53:02.236581+00:00, run_end_date=2024-07-04 02:53:03.572605+00:00, run_duration=1.336024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:53:00.239912+00:00, queued_by_job_id=2, pid=7073 2024-07-04T02:54:00.277550826Z [2024-07-04T02:54:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:54:00+00:00, run_after=2024-07-04T02:55:00+00:00 2024-07-04T02:54:00.285159797Z [2024-07-04T02:54:00.284+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:54:00.291513267Z [2024-07-04T02:54:00.291+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:54:00.368770564Z [2024-07-04T02:54:00.368+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:54:00.368798080Z 2024-07-04T02:54:00.368802626Z 2024-07-04T02:54:00.368806326Z 2024-07-04T02:54:00.369050806Z [2024-07-04T02:54:00.368+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:54:00.369242620Z [2024-07-04T02:54:00.369+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:54:00.369434238Z [2024-07-04T02:54:00.369+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:54:00.370091982Z [2024-07-04T02:54:00.369+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:54:00.370104325Z 2024-07-04T02:54:00.370108010Z 2024-07-04T02:54:00.370125871Z 2024-07-04T02:54:00.373807119Z [2024-07-04T02:54:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:54:00.374085902Z [2024-07-04T02:54:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:54:00.375372109Z [2024-07-04T02:54:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:54:00.375627352Z [2024-07-04T02:54:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:54:00.375949450Z [2024-07-04T02:54:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:54:00.376171255Z [2024-07-04T02:54:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:54:00.964801473Z [2024-07-04T02:54:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:52:00+00:00 exited with status queued for try_number 1 2024-07-04T02:54:00.964973645Z [2024-07-04T02:54:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:53:00+00:00 exited with status queued for try_number 1 2024-07-04T02:54:00.965141385Z [2024-07-04T02:54:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:53:00+00:00 exited with status queued for try_number 1 2024-07-04T02:54:00.976512237Z [2024-07-04T02:54:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed097b54-0c93-4df5-8133-99bcb452f040 2024-07-04T02:54:00.976782812Z [2024-07-04T02:54:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to a186e1a0-fa38-4af3-b615-a297d76921c3 2024-07-04T02:54:00.976978300Z [2024-07-04T02:54:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to e40058d5-387c-4999-a7ec-9bcae4fa6a33 2024-07-04T02:54:02.306999847Z [2024-07-04T02:54:02.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:54:02.307260312Z [2024-07-04T02:54:02.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:52:00+00:00, run_id=scheduled__2024-07-04T02:52:00+00:00, run_start_date=2024-07-04 02:54:00.307322+00:00, run_end_date=2024-07-04 02:54:02.306938+00:00, run_duration=1.999616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:52:00+00:00, data_interval_end=2024-07-04 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:54:02.316475720Z [2024-07-04T02:54:02.316+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:54:00+00:00, run_after=2024-07-04T02:56:00+00:00 2024-07-04T02:54:02.971747572Z [2024-07-04T02:54:02.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:52:00+00:00 exited with status success for try_number 1 2024-07-04T02:54:02.978473308Z [2024-07-04T02:54:02.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:52:00+00:00, map_index=-1, run_start_date=2024-07-04 02:54:01.866460+00:00, run_end_date=2024-07-04 02:54:02.251705+00:00, run_duration=0.385245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:54:00.370951+00:00, queued_by_job_id=2, pid=7109 2024-07-04T02:54:05.217642755Z [2024-07-04T02:54:05.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:54:05.217820063Z [2024-07-04T02:54:05.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:53:00+00:00, run_id=scheduled__2024-07-04T02:53:00+00:00, run_start_date=2024-07-04 02:54:00.308651+00:00, run_end_date=2024-07-04 02:54:05.217502+00:00, run_duration=4.908851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:53:00+00:00, data_interval_end=2024-07-04 02:54:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:54:05.226981981Z [2024-07-04T02:54:05.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:54:00+00:00, run_after=2024-07-04T02:55:00+00:00 2024-07-04T02:54:05.238381098Z [2024-07-04T02:54:05.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:54:05.238535467Z [2024-07-04T02:54:05.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:53:00+00:00, run_id=scheduled__2024-07-04T02:53:00+00:00, run_start_date=2024-07-04 02:54:00.309772+00:00, run_end_date=2024-07-04 02:54:05.238302+00:00, run_duration=4.92853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:53:00+00:00, data_interval_end=2024-07-04 02:54:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:54:05.249819322Z [2024-07-04T02:54:05.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:54:00+00:00, run_after=2024-07-04T02:55:00+00:00 2024-07-04T02:54:05.286570960Z [2024-07-04T02:54:05.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:53:00+00:00 exited with status success for try_number 1 2024-07-04T02:54:05.286685293Z [2024-07-04T02:54:05.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:53:00+00:00 exited with status success for try_number 1 2024-07-04T02:54:05.295214736Z [2024-07-04T02:54:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:53:00+00:00, map_index=-1, run_start_date=2024-07-04 02:54:02.988927+00:00, run_end_date=2024-07-04 02:54:04.501917+00:00, run_duration=1.51299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:54:00.370951+00:00, queued_by_job_id=2, pid=7140 2024-07-04T02:54:05.295353265Z [2024-07-04T02:54:05.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:53:00+00:00, map_index=-1, run_start_date=2024-07-04 02:54:02.865783+00:00, run_end_date=2024-07-04 02:54:04.772974+00:00, run_duration=1.907191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:54:00.370951+00:00, queued_by_job_id=2, pid=7139 2024-07-04T02:55:00.145796007Z [2024-07-04T02:55:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:55:00+00:00, run_after=2024-07-04T03:00:00+00:00 2024-07-04T02:55:00.153981255Z [2024-07-04T02:55:00.153+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:55:00.165532775Z [2024-07-04T02:55:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:55:00+00:00, run_after=2024-07-04T02:56:00+00:00 2024-07-04T02:55:00.236225221Z [2024-07-04T02:55:00.235+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:55:00.236260989Z 2024-07-04T02:55:00.236271793Z 2024-07-04T02:55:00.236276677Z 2024-07-04T02:55:00.236281742Z [2024-07-04T02:55:00.236+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:55:00.236408537Z [2024-07-04T02:55:00.236+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:55:00.236989249Z [2024-07-04T02:55:00.236+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:55:00.237708432Z [2024-07-04T02:55:00.237+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:55:00.237728592Z 2024-07-04T02:55:00.237754587Z 2024-07-04T02:55:00.237758367Z 2024-07-04T02:55:00.241114539Z [2024-07-04T02:55:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T02:55:00.241266818Z [2024-07-04T02:55:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:55:00.241584897Z [2024-07-04T02:55:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:55:00.241762880Z [2024-07-04T02:55:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:55:00.242121883Z [2024-07-04T02:55:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:55:00.242306985Z [2024-07-04T02:55:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:55:00.764155364Z [2024-07-04T02:55:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status queued for try_number 1 2024-07-04T02:55:00.764261588Z [2024-07-04T02:55:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:54:00+00:00 exited with status queued for try_number 1 2024-07-04T02:55:00.764267135Z [2024-07-04T02:55:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:54:00+00:00 exited with status queued for try_number 1 2024-07-04T02:55:00.781850400Z [2024-07-04T02:55:00.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 133956d3-a745-4178-a529-7c9058a88b8b 2024-07-04T02:55:00.781979179Z [2024-07-04T02:55:00.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d367f50-2870-4e60-84c3-94f77fdf0caf 2024-07-04T02:55:00.782083996Z [2024-07-04T02:55:00.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb3d9063-e2b3-43b0-b26b-176c6f1d90d0 2024-07-04T02:55:03.287377124Z [2024-07-04T02:55:03.287+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:55:03.287395092Z 2024-07-04T02:55:03.288051433Z [2024-07-04T02:55:03.287+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:55:03.288662453Z [2024-07-04T02:55:03.288+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:55:03.288676401Z 2024-07-04T02:55:03.292160543Z [2024-07-04T02:55:03.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T02:55:03.292391681Z [2024-07-04T02:55:03.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:55:03.371109048Z [2024-07-04T02:55:03.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status queued for try_number 1 2024-07-04T02:55:03.380084716Z [2024-07-04T02:55:03.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14dc8b78-a776-4b7d-a886-d5337665d5b6 2024-07-04T02:55:03.505127458Z [2024-07-04T02:55:03.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status success for try_number 1 2024-07-04T02:55:03.512310679Z [2024-07-04T02:55:03.511+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:50:00+00:00, map_index=-1, run_start_date=2024-07-04 02:55:02.767375+00:00, run_end_date=2024-07-04 02:55:03.160739+00:00, run_duration=0.393364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:55:00.238510+00:00, queued_by_job_id=2, pid=7187 2024-07-04T02:55:04.566490045Z [2024-07-04T02:55:04.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:55:04.566811808Z [2024-07-04T02:55:04.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:54:00+00:00, run_id=scheduled__2024-07-04T02:54:00+00:00, run_start_date=2024-07-04 02:55:00.178616+00:00, run_end_date=2024-07-04 02:55:04.566193+00:00, run_duration=4.387577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:54:00+00:00, data_interval_end=2024-07-04 02:55:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:55:04.584609253Z [2024-07-04T02:55:04.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:55:00+00:00, run_after=2024-07-04T02:56:00+00:00 2024-07-04T02:55:04.654216792Z [2024-07-04T02:55:04.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:54:00+00:00 exited with status success for try_number 1 2024-07-04T02:55:04.662722185Z [2024-07-04T02:55:04.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:54:00+00:00, map_index=-1, run_start_date=2024-07-04 02:55:02.986530+00:00, run_end_date=2024-07-04 02:55:04.259333+00:00, run_duration=1.272803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:55:00.238510+00:00, queued_by_job_id=2, pid=7197 2024-07-04T02:55:05.716484117Z [2024-07-04T02:55:05.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:55:05.719063332Z [2024-07-04T02:55:05.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:54:00+00:00, run_id=scheduled__2024-07-04T02:54:00+00:00, run_start_date=2024-07-04 02:55:00.181417+00:00, run_end_date=2024-07-04 02:55:05.716408+00:00, run_duration=5.534991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:54:00+00:00, data_interval_end=2024-07-04 02:55:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:55:05.730236842Z [2024-07-04T02:55:05.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:55:00+00:00, run_after=2024-07-04T02:56:00+00:00 2024-07-04T02:55:05.757908071Z [2024-07-04T02:55:05.757+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:55:05.757938601Z 2024-07-04T02:55:05.757943824Z [2024-07-04T02:55:05.757+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:55:05.758530997Z [2024-07-04T02:55:05.758+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:55:05.758552414Z 2024-07-04T02:55:05.760819021Z [2024-07-04T02:55:05.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T02:55:05.760901133Z [2024-07-04T02:55:05.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:55:05.804081225Z [2024-07-04T02:55:05.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status queued for try_number 1 2024-07-04T02:55:05.804176616Z [2024-07-04T02:55:05.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:54:00+00:00 exited with status success for try_number 1 2024-07-04T02:55:05.804214390Z [2024-07-04T02:55:05.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status success for try_number 1 2024-07-04T02:55:05.812661706Z [2024-07-04T02:55:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:50:00+00:00, map_index=-1, run_start_date=2024-07-04 02:55:05.088223+00:00, run_end_date=2024-07-04 02:55:05.501494+00:00, run_duration=0.413271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:55:03.289741+00:00, queued_by_job_id=2, pid=7246 2024-07-04T02:55:05.812762149Z [2024-07-04T02:55:05.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38d0c1ab-143e-4d38-827e-ef822187259d 2024-07-04T02:55:05.812881656Z [2024-07-04T02:55:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:54:00+00:00, map_index=-1, run_start_date=2024-07-04 02:55:03.487029+00:00, run_end_date=2024-07-04 02:55:05.248431+00:00, run_duration=1.761402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:55:00.238510+00:00, queued_by_job_id=2, pid=7226 2024-07-04T02:55:09.144791464Z [2024-07-04T02:55:09.144+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T02:55:09.144830346Z 2024-07-04T02:55:09.147027039Z [2024-07-04T02:55:09.144+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:55:09.147066235Z [2024-07-04T02:55:09.145+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:55:09.147072677Z 2024-07-04T02:55:09.149334168Z [2024-07-04T02:55:09.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:55:09.149647000Z [2024-07-04T02:55:09.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:55:09.290638931Z [2024-07-04T02:55:09.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status queued for try_number 1 2024-07-04T02:55:09.290689714Z [2024-07-04T02:55:09.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status success for try_number 1 2024-07-04T02:55:09.296805305Z [2024-07-04T02:55:09.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24c5a01a-6d57-4ce2-b94c-50e781cb8c5c 2024-07-04T02:55:09.297090230Z [2024-07-04T02:55:09.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:50:00+00:00, map_index=0, run_start_date=2024-07-04 02:55:07.674791+00:00, run_end_date=2024-07-04 02:55:08.162054+00:00, run_duration=0.487263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:55:05.758797+00:00, queued_by_job_id=2, pid=7257 2024-07-04T02:55:12.061004840Z [2024-07-04T02:55:12.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:55:12.061634964Z [2024-07-04T02:55:12.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:50:00+00:00, run_id=scheduled__2024-07-04T02:50:00+00:00, run_start_date=2024-07-04 02:55:00.177403+00:00, run_end_date=2024-07-04 02:55:12.061177+00:00, run_duration=11.883774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:50:00+00:00, data_interval_end=2024-07-04 02:55:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T02:55:12.069763778Z [2024-07-04T02:55:12.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:55:00+00:00, run_after=2024-07-04T03:00:00+00:00 2024-07-04T02:55:12.120570484Z [2024-07-04T02:55:12.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:50:00+00:00 exited with status success for try_number 1 2024-07-04T02:55:12.132012884Z [2024-07-04T02:55:12.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:50:00+00:00, map_index=-1, run_start_date=2024-07-04 02:55:10.843023+00:00, run_end_date=2024-07-04 02:55:11.255976+00:00, run_duration=0.412953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:55:09.145969+00:00, queued_by_job_id=2, pid=7269 2024-07-04T02:56:00.867870334Z [2024-07-04T02:56:00.867+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:56:00.888917545Z [2024-07-04T02:56:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:56:00+00:00, run_after=2024-07-04T02:57:00+00:00 2024-07-04T02:56:00.901053418Z [2024-07-04T02:56:00.900+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:56:00.978925634Z [2024-07-04T02:56:00.978+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:56:00.978951461Z 2024-07-04T02:56:00.978971270Z 2024-07-04T02:56:00.978974879Z 2024-07-04T02:56:00.981000517Z [2024-07-04T02:56:00.978+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:56:00.981212896Z [2024-07-04T02:56:00.980+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:56:00.981381981Z [2024-07-04T02:56:00.981+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:56:00.982157786Z [2024-07-04T02:56:00.981+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:56:00.982208686Z 2024-07-04T02:56:00.982213608Z 2024-07-04T02:56:00.982217028Z 2024-07-04T02:56:00.987818727Z [2024-07-04T02:56:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:56:00.988102529Z [2024-07-04T02:56:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:56:00.988374921Z [2024-07-04T02:56:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:56:00.988510957Z [2024-07-04T02:56:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:56:00.988756569Z [2024-07-04T02:56:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:56:00.988855276Z [2024-07-04T02:56:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:56:01.564482626Z [2024-07-04T02:56:01.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:54:00+00:00 exited with status queued for try_number 1 2024-07-04T02:56:01.566210553Z [2024-07-04T02:56:01.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status queued for try_number 1 2024-07-04T02:56:01.566498323Z [2024-07-04T02:56:01.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status queued for try_number 1 2024-07-04T02:56:01.580851911Z [2024-07-04T02:56:01.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to cef2c9b5-3497-4703-9fb6-faf0b59f0be6 2024-07-04T02:56:01.581164655Z [2024-07-04T02:56:01.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to c100b8b0-2e8d-4683-96f5-665e437a243b 2024-07-04T02:56:01.581450734Z [2024-07-04T02:56:01.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to 192afd1e-d44a-4cde-bb7c-ff1511ef2b58 2024-07-04T02:56:02.842962835Z [2024-07-04T02:56:02.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:56:02.843426631Z [2024-07-04T02:56:02.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:54:00+00:00, run_id=scheduled__2024-07-04T02:54:00+00:00, run_start_date=2024-07-04 02:56:00.911935+00:00, run_end_date=2024-07-04 02:56:02.842901+00:00, run_duration=1.930966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:54:00+00:00, data_interval_end=2024-07-04 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:56:02.854736050Z [2024-07-04T02:56:02.854+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:56:00+00:00, run_after=2024-07-04T02:58:00+00:00 2024-07-04T02:56:02.929743571Z [2024-07-04T02:56:02.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:54:00+00:00 exited with status success for try_number 1 2024-07-04T02:56:02.943300784Z [2024-07-04T02:56:02.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:54:00+00:00, map_index=-1, run_start_date=2024-07-04 02:56:02.105914+00:00, run_end_date=2024-07-04 02:56:02.479073+00:00, run_duration=0.373159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:56:00.983200+00:00, queued_by_job_id=2, pid=7286 2024-07-04T02:56:04.776376663Z [2024-07-04T02:56:04.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:56:04.776403167Z [2024-07-04T02:56:04.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:55:00+00:00, run_id=scheduled__2024-07-04T02:55:00+00:00, run_start_date=2024-07-04 02:56:00.913957+00:00, run_end_date=2024-07-04 02:56:04.775260+00:00, run_duration=3.861303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:55:00+00:00, data_interval_end=2024-07-04 02:56:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:56:04.790521895Z [2024-07-04T02:56:04.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:56:00+00:00, run_after=2024-07-04T02:57:00+00:00 2024-07-04T02:56:04.842111459Z [2024-07-04T02:56:04.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status success for try_number 1 2024-07-04T02:56:04.849792167Z [2024-07-04T02:56:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:55:00+00:00, map_index=-1, run_start_date=2024-07-04 02:56:03.021258+00:00, run_end_date=2024-07-04 02:56:04.520266+00:00, run_duration=1.499008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:56:00.983200+00:00, queued_by_job_id=2, pid=7316 2024-07-04T02:56:05.911679810Z [2024-07-04T02:56:05.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:56:05.912172887Z [2024-07-04T02:56:05.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:55:00+00:00, run_id=scheduled__2024-07-04T02:55:00+00:00, run_start_date=2024-07-04 02:56:00.915135+00:00, run_end_date=2024-07-04 02:56:05.911773+00:00, run_duration=4.996638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:55:00+00:00, data_interval_end=2024-07-04 02:56:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:56:05.924427397Z [2024-07-04T02:56:05.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:56:00+00:00, run_after=2024-07-04T02:57:00+00:00 2024-07-04T02:56:05.970437173Z [2024-07-04T02:56:05.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status success for try_number 1 2024-07-04T02:56:05.978133385Z [2024-07-04T02:56:05.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:55:00+00:00, map_index=-1, run_start_date=2024-07-04 02:56:03.034395+00:00, run_end_date=2024-07-04 02:56:04.847085+00:00, run_duration=1.81269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:56:00.983200+00:00, queued_by_job_id=2, pid=7317 2024-07-04T02:56:22.138679923Z [2024-07-04T02:56:22.138+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T02:57:00.660880250Z [2024-07-04T02:57:00.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:57:00+00:00, run_after=2024-07-04T02:58:00+00:00 2024-07-04T02:57:00.671593696Z [2024-07-04T02:57:00.671+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:57:00.737478596Z [2024-07-04T02:57:00.737+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:57:00.737510195Z 2024-07-04T02:57:00.737515274Z 2024-07-04T02:57:00.737536555Z [2024-07-04T02:57:00.737+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:57:00.737603802Z [2024-07-04T02:57:00.737+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:57:00.738615832Z [2024-07-04T02:57:00.738+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:57:00.738629288Z 2024-07-04T02:57:00.738633856Z 2024-07-04T02:57:00.741994110Z [2024-07-04T02:57:00.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:57:00.742188059Z [2024-07-04T02:57:00.741+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:57:00.742614207Z [2024-07-04T02:57:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:57:00.742774399Z [2024-07-04T02:57:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:57:00.983349056Z [2024-07-04T02:57:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:56:00+00:00 exited with status queued for try_number 1 2024-07-04T02:57:00.983497383Z [2024-07-04T02:57:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:56:00+00:00 exited with status queued for try_number 1 2024-07-04T02:57:00.990733282Z [2024-07-04T02:57:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c56b3e5-b170-4248-9951-61a0edf193f8 2024-07-04T02:57:00.990769024Z [2024-07-04T02:57:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8907cb1-3110-44d0-99f7-cf0beb2e4130 2024-07-04T02:57:03.942812842Z [2024-07-04T02:57:03.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:57:03.943314493Z [2024-07-04T02:57:03.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:56:00+00:00, run_id=scheduled__2024-07-04T02:56:00+00:00, run_start_date=2024-07-04 02:57:00.682864+00:00, run_end_date=2024-07-04 02:57:03.942743+00:00, run_duration=3.259879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:56:00+00:00, data_interval_end=2024-07-04 02:57:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:57:03.953241659Z [2024-07-04T02:57:03.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:57:00+00:00, run_after=2024-07-04T02:58:00+00:00 2024-07-04T02:57:04.007677563Z [2024-07-04T02:57:04.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:56:00+00:00 exited with status success for try_number 1 2024-07-04T02:57:04.013136605Z [2024-07-04T02:57:04.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:56:00+00:00, map_index=-1, run_start_date=2024-07-04 02:57:02.469388+00:00, run_end_date=2024-07-04 02:57:03.773046+00:00, run_duration=1.303658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:57:00.739376+00:00, queued_by_job_id=2, pid=7372 2024-07-04T02:57:05.070558776Z [2024-07-04T02:57:05.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:57:05.070949313Z [2024-07-04T02:57:05.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:56:00+00:00, run_id=scheduled__2024-07-04T02:56:00+00:00, run_start_date=2024-07-04 02:57:00.684360+00:00, run_end_date=2024-07-04 02:57:05.070331+00:00, run_duration=4.385971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:56:00+00:00, data_interval_end=2024-07-04 02:57:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:57:05.080911450Z [2024-07-04T02:57:05.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:57:00+00:00, run_after=2024-07-04T02:58:00+00:00 2024-07-04T02:57:05.120360315Z [2024-07-04T02:57:05.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:56:00+00:00 exited with status success for try_number 1 2024-07-04T02:57:05.129549090Z [2024-07-04T02:57:05.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:56:00+00:00, map_index=-1, run_start_date=2024-07-04 02:57:02.475851+00:00, run_end_date=2024-07-04 02:57:04.153797+00:00, run_duration=1.677946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:57:00.739376+00:00, queued_by_job_id=2, pid=7373 2024-07-04T02:58:00.481991191Z [2024-07-04T02:58:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:58:00+00:00, run_after=2024-07-04T02:59:00+00:00 2024-07-04T02:58:00.497487319Z [2024-07-04T02:58:00.496+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:58:00.507023441Z [2024-07-04T02:58:00.506+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:58:00.623143715Z [2024-07-04T02:58:00.622+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T02:58:00.623172021Z 2024-07-04T02:58:00.623179561Z 2024-07-04T02:58:00.623183086Z 2024-07-04T02:58:00.623226752Z [2024-07-04T02:58:00.623+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T02:58:00.623474365Z [2024-07-04T02:58:00.623+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:58:00.623701224Z [2024-07-04T02:58:00.623+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:58:00.624381385Z [2024-07-04T02:58:00.624+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:58:00.624398966Z 2024-07-04T02:58:00.624405185Z 2024-07-04T02:58:00.624409566Z 2024-07-04T02:58:00.630308076Z [2024-07-04T02:58:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:58:00.631222184Z [2024-07-04T02:58:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:58:00.633038162Z [2024-07-04T02:58:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:58:00.633234218Z [2024-07-04T02:58:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:58:00.633673608Z [2024-07-04T02:58:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:58:00.633950350Z [2024-07-04T02:58:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:58:01.070539824Z [2024-07-04T02:58:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:56:00+00:00 exited with status queued for try_number 1 2024-07-04T02:58:01.073587110Z [2024-07-04T02:58:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:57:00+00:00 exited with status queued for try_number 1 2024-07-04T02:58:01.073719456Z [2024-07-04T02:58:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:57:00+00:00 exited with status queued for try_number 1 2024-07-04T02:58:01.085884264Z [2024-07-04T02:58:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to e845f038-2f7e-441c-9db2-a57533f612c2 2024-07-04T02:58:01.086796357Z [2024-07-04T02:58:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13798795-2109-428b-b807-89527378b81a 2024-07-04T02:58:01.087188991Z [2024-07-04T02:58:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24d61027-6dba-4572-9d0d-529920ec83c5 2024-07-04T02:58:03.395213639Z [2024-07-04T02:58:03.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:58:03.395938703Z [2024-07-04T02:58:03.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:56:00+00:00, run_id=scheduled__2024-07-04T02:56:00+00:00, run_start_date=2024-07-04 02:58:00.532181+00:00, run_end_date=2024-07-04 02:58:03.395481+00:00, run_duration=2.8633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:56:00+00:00, data_interval_end=2024-07-04 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T02:58:03.414711352Z [2024-07-04T02:58:03.414+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T02:58:00+00:00, run_after=2024-07-04T03:00:00+00:00 2024-07-04T02:58:03.502296361Z [2024-07-04T02:58:03.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:56:00+00:00 exited with status success for try_number 1 2024-07-04T02:58:03.509133851Z [2024-07-04T02:58:03.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:56:00+00:00, map_index=-1, run_start_date=2024-07-04 02:58:02.052205+00:00, run_end_date=2024-07-04 02:58:02.583906+00:00, run_duration=0.531701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:58:00.625211+00:00, queued_by_job_id=2, pid=7408 2024-07-04T02:58:05.429727943Z [2024-07-04T02:58:05.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:58:05.430366701Z [2024-07-04T02:58:05.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:57:00+00:00, run_id=scheduled__2024-07-04T02:57:00+00:00, run_start_date=2024-07-04 02:58:00.534829+00:00, run_end_date=2024-07-04 02:58:05.429394+00:00, run_duration=4.894565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:57:00+00:00, data_interval_end=2024-07-04 02:58:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:58:05.451074303Z [2024-07-04T02:58:05.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:58:00+00:00, run_after=2024-07-04T02:59:00+00:00 2024-07-04T02:58:05.504058441Z [2024-07-04T02:58:05.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:57:00+00:00 exited with status success for try_number 1 2024-07-04T02:58:05.512426556Z [2024-07-04T02:58:05.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:57:00+00:00, map_index=-1, run_start_date=2024-07-04 02:58:03.084243+00:00, run_end_date=2024-07-04 02:58:04.745299+00:00, run_duration=1.661056, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:58:00.625211+00:00, queued_by_job_id=2, pid=7429 2024-07-04T02:58:06.562634383Z [2024-07-04T02:58:06.562+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:58:06.562815915Z [2024-07-04T02:58:06.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:57:00+00:00, run_id=scheduled__2024-07-04T02:57:00+00:00, run_start_date=2024-07-04 02:58:00.536789+00:00, run_end_date=2024-07-04 02:58:06.562534+00:00, run_duration=6.025745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:57:00+00:00, data_interval_end=2024-07-04 02:58:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:58:06.571960630Z [2024-07-04T02:58:06.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:58:00+00:00, run_after=2024-07-04T02:59:00+00:00 2024-07-04T02:58:06.601872899Z [2024-07-04T02:58:06.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:57:00+00:00 exited with status success for try_number 1 2024-07-04T02:58:06.609866773Z [2024-07-04T02:58:06.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:57:00+00:00, map_index=-1, run_start_date=2024-07-04 02:58:03.431636+00:00, run_end_date=2024-07-04 02:58:05.397245+00:00, run_duration=1.965609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:58:00.625211+00:00, queued_by_job_id=2, pid=7448 2024-07-04T02:59:00.457653692Z [2024-07-04T02:59:00.457+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T02:59:00.470516221Z [2024-07-04T02:59:00.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:59:00+00:00, run_after=2024-07-04T03:00:00+00:00 2024-07-04T02:59:00.526572064Z [2024-07-04T02:59:00.526+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T02:59:00.526600175Z 2024-07-04T02:59:00.526606208Z 2024-07-04T02:59:00.526665700Z [2024-07-04T02:59:00.526+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:59:00.526693837Z [2024-07-04T02:59:00.526+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T02:59:00.527387691Z [2024-07-04T02:59:00.527+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T02:59:00.527403857Z 2024-07-04T02:59:00.527407647Z 2024-07-04T02:59:00.530449973Z [2024-07-04T02:59:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:59:00.530526675Z [2024-07-04T02:59:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:59:00.530746475Z [2024-07-04T02:59:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T02:59:00.530886474Z [2024-07-04T02:59:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:59:00.713908735Z [2024-07-04T02:59:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:58:00+00:00 exited with status queued for try_number 1 2024-07-04T02:59:00.717031826Z [2024-07-04T02:59:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:58:00+00:00 exited with status queued for try_number 1 2024-07-04T02:59:00.729303042Z [2024-07-04T02:59:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to d80d0e7b-ad93-49bb-9092-965974c8265a 2024-07-04T02:59:00.729914383Z [2024-07-04T02:59:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a10fd38-8e85-49a8-9efc-aa8708e36406 2024-07-04T02:59:04.481173735Z [2024-07-04T02:59:04.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:59:04.481327067Z [2024-07-04T02:59:04.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:58:00+00:00, run_id=scheduled__2024-07-04T02:58:00+00:00, run_start_date=2024-07-04 02:59:00.487705+00:00, run_end_date=2024-07-04 02:59:04.481036+00:00, run_duration=3.993331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:58:00+00:00, data_interval_end=2024-07-04 02:59:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T02:59:04.489894100Z [2024-07-04T02:59:04.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:59:00+00:00, run_after=2024-07-04T03:00:00+00:00 2024-07-04T02:59:04.560493747Z [2024-07-04T02:59:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:58:00+00:00 exited with status success for try_number 1 2024-07-04T02:59:04.568909393Z [2024-07-04T02:59:04.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:58:00+00:00, map_index=-1, run_start_date=2024-07-04 02:59:02.475145+00:00, run_end_date=2024-07-04 02:59:04.105976+00:00, run_duration=1.630831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:59:00.527880+00:00, queued_by_job_id=2, pid=7493 2024-07-04T02:59:05.627194395Z [2024-07-04T02:59:05.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T02:59:05.627648075Z [2024-07-04T02:59:05.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:58:00+00:00, run_id=scheduled__2024-07-04T02:58:00+00:00, run_start_date=2024-07-04 02:59:00.489155+00:00, run_end_date=2024-07-04 02:59:05.627028+00:00, run_duration=5.137873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:58:00+00:00, data_interval_end=2024-07-04 02:59:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T02:59:05.640766767Z [2024-07-04T02:59:05.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T02:59:00+00:00, run_after=2024-07-04T03:00:00+00:00 2024-07-04T02:59:05.685946695Z [2024-07-04T02:59:05.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:58:00+00:00 exited with status success for try_number 1 2024-07-04T02:59:05.695788270Z [2024-07-04T02:59:05.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:58:00+00:00, map_index=-1, run_start_date=2024-07-04 02:59:02.500305+00:00, run_end_date=2024-07-04 02:59:04.470072+00:00, run_duration=1.969767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 02:59:00.527880+00:00, queued_by_job_id=2, pid=7494 2024-07-04T03:00:00.248309628Z [2024-07-04T03:00:00.246+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:00:00.268782533Z [2024-07-04T03:00:00.268+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:00:00.302721922Z [2024-07-04T03:00:00.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:00:00+00:00, run_after=2024-07-04T03:05:00+00:00 2024-07-04T03:00:00.319521699Z [2024-07-04T03:00:00.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:00:00+00:00, run_after=2024-07-04T03:01:00+00:00 2024-07-04T03:00:00.407426754Z [2024-07-04T03:00:00.407+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T03:00:00.407457378Z 2024-07-04T03:00:00.407460976Z 2024-07-04T03:00:00.407465160Z 2024-07-04T03:00:00.407468377Z 2024-07-04T03:00:00.408179183Z [2024-07-04T03:00:00.407+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:00:00.408432805Z [2024-07-04T03:00:00.408+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:00:00.408625376Z [2024-07-04T03:00:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:00:00.409211922Z [2024-07-04T03:00:00.408+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:00:00.410046256Z [2024-07-04T03:00:00.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:00:00.410057435Z 2024-07-04T03:00:00.410061972Z 2024-07-04T03:00:00.410065361Z 2024-07-04T03:00:00.410068415Z 2024-07-04T03:00:00.414462709Z [2024-07-04T03:00:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:00:00.414722212Z [2024-07-04T03:00:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:00:00.415089389Z [2024-07-04T03:00:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:00:00.415290628Z [2024-07-04T03:00:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:00:00.415594476Z [2024-07-04T03:00:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:00:00.415777194Z [2024-07-04T03:00:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:00:00.416071258Z [2024-07-04T03:00:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:00:00.416254887Z [2024-07-04T03:00:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:00:00.824674378Z [2024-07-04T03:00:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status queued for try_number 1 2024-07-04T03:00:00.824708345Z [2024-07-04T03:00:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:58:00+00:00 exited with status queued for try_number 1 2024-07-04T03:00:00.824786931Z [2024-07-04T03:00:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:59:00+00:00 exited with status queued for try_number 1 2024-07-04T03:00:00.824845065Z [2024-07-04T03:00:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:59:00+00:00 exited with status queued for try_number 1 2024-07-04T03:00:00.840645207Z [2024-07-04T03:00:00.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfd8384d-5aff-4a9a-a36f-cc79c62e7dba 2024-07-04T03:00:00.840680474Z [2024-07-04T03:00:00.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to a369c16d-1b74-43f5-a41e-5e68c04092f4 2024-07-04T03:00:00.840820251Z [2024-07-04T03:00:00.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to c39002bc-6f14-40fe-8675-0f673152a079 2024-07-04T03:00:00.840895895Z [2024-07-04T03:00:00.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4edb24a-860e-4bdd-9001-3d4f3c3dda50 2024-07-04T03:00:03.461990360Z [2024-07-04T03:00:03.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:00:03.462231952Z [2024-07-04T03:00:03.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 02:58:00+00:00, run_id=scheduled__2024-07-04T02:58:00+00:00, run_start_date=2024-07-04 03:00:00.336212+00:00, run_end_date=2024-07-04 03:00:03.461919+00:00, run_duration=3.125707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:58:00+00:00, data_interval_end=2024-07-04 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:00:03.469259023Z [2024-07-04T03:00:03.468+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:00:00+00:00, run_after=2024-07-04T03:02:00+00:00 2024-07-04T03:00:03.512224473Z [2024-07-04T03:00:03.511+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:00:03.512253648Z 2024-07-04T03:00:03.512423406Z [2024-07-04T03:00:03.512+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:00:03.512889310Z [2024-07-04T03:00:03.512+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:00:03.512897149Z 2024-07-04T03:00:03.515060978Z [2024-07-04T03:00:03.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:00:03.515182043Z [2024-07-04T03:00:03.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:00:03.584872022Z [2024-07-04T03:00:03.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status queued for try_number 1 2024-07-04T03:00:03.587812163Z [2024-07-04T03:00:03.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status success for try_number 1 2024-07-04T03:00:03.588139185Z [2024-07-04T03:00:03.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T02:58:00+00:00 exited with status success for try_number 1 2024-07-04T03:00:03.596859558Z [2024-07-04T03:00:03.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T02:58:00+00:00, map_index=-1, run_start_date=2024-07-04 03:00:01.842182+00:00, run_end_date=2024-07-04 03:00:02.434094+00:00, run_duration=0.591912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:00:00.411294+00:00, queued_by_job_id=2, pid=7531 2024-07-04T03:00:03.597350555Z [2024-07-04T03:00:03.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T02:55:00+00:00, map_index=-1, run_start_date=2024-07-04 03:00:02.865963+00:00, run_end_date=2024-07-04 03:00:03.249736+00:00, run_duration=0.383773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:00:00.411294+00:00, queued_by_job_id=2, pid=7563 2024-07-04T03:00:03.597722350Z [2024-07-04T03:00:03.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to abf0a9c7-c0bb-4210-a024-1db0ab9ff04c 2024-07-04T03:00:04.758997859Z [2024-07-04T03:00:04.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:00:04.759036140Z [2024-07-04T03:00:04.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:59:00+00:00, run_id=scheduled__2024-07-04T02:59:00+00:00, run_start_date=2024-07-04 03:00:00.337244+00:00, run_end_date=2024-07-04 03:00:04.756082+00:00, run_duration=4.418838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:59:00+00:00, data_interval_end=2024-07-04 03:00:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:00:04.772199700Z [2024-07-04T03:00:04.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:00:00+00:00, run_after=2024-07-04T03:01:00+00:00 2024-07-04T03:00:04.783469431Z [2024-07-04T03:00:04.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:00:04.783511879Z [2024-07-04T03:00:04.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:59:00+00:00, run_id=scheduled__2024-07-04T02:59:00+00:00, run_start_date=2024-07-04 03:00:00.338184+00:00, run_end_date=2024-07-04 03:00:04.781238+00:00, run_duration=4.443054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:59:00+00:00, data_interval_end=2024-07-04 03:00:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:00:04.803770764Z [2024-07-04T03:00:04.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:00:00+00:00, run_after=2024-07-04T03:01:00+00:00 2024-07-04T03:00:04.867716995Z [2024-07-04T03:00:04.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:59:00+00:00 exited with status success for try_number 1 2024-07-04T03:00:04.886938198Z [2024-07-04T03:00:04.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:59:00+00:00, map_index=-1, run_start_date=2024-07-04 03:00:03.058728+00:00, run_end_date=2024-07-04 03:00:04.410635+00:00, run_duration=1.351907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:00:00.411294+00:00, queued_by_job_id=2, pid=7571 2024-07-04T03:00:05.985076265Z [2024-07-04T03:00:05.984+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:00:05.985107584Z 2024-07-04T03:00:05.985278750Z [2024-07-04T03:00:05.984+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:00:05.986434958Z [2024-07-04T03:00:05.986+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:00:05.986444792Z 2024-07-04T03:00:05.990206188Z [2024-07-04T03:00:05.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:00:05.990509949Z [2024-07-04T03:00:05.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:00:06.055869657Z [2024-07-04T03:00:06.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status queued for try_number 1 2024-07-04T03:00:06.055905855Z [2024-07-04T03:00:06.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T02:59:00+00:00 exited with status success for try_number 1 2024-07-04T03:00:06.055930456Z [2024-07-04T03:00:06.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status success for try_number 1 2024-07-04T03:00:06.064647902Z [2024-07-04T03:00:06.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T02:55:00+00:00, map_index=-1, run_start_date=2024-07-04 03:00:05.302566+00:00, run_end_date=2024-07-04 03:00:05.705246+00:00, run_duration=0.40268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:00:03.513142+00:00, queued_by_job_id=2, pid=7611 2024-07-04T03:00:06.064680105Z [2024-07-04T03:00:06.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T02:59:00+00:00, map_index=-1, run_start_date=2024-07-04 03:00:03.059213+00:00, run_end_date=2024-07-04 03:00:04.640846+00:00, run_duration=1.581633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:00:00.411294+00:00, queued_by_job_id=2, pid=7572 2024-07-04T03:00:06.065006763Z [2024-07-04T03:00:06.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to de71bedc-ba8e-464c-91fe-37e25ad48546 2024-07-04T03:00:08.997321980Z [2024-07-04T03:00:08.996+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:00:08.997380174Z 2024-07-04T03:00:08.997393173Z [2024-07-04T03:00:08.997+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:00:08.997992812Z [2024-07-04T03:00:08.997+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:00:08.998014446Z 2024-07-04T03:00:09.002919054Z [2024-07-04T03:00:09.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:00:09.002975274Z [2024-07-04T03:00:09.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:00:09.110437986Z [2024-07-04T03:00:09.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status queued for try_number 1 2024-07-04T03:00:09.110862132Z [2024-07-04T03:00:09.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status success for try_number 1 2024-07-04T03:00:09.130156853Z [2024-07-04T03:00:09.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to b12001cf-4fce-477a-8d9c-aeacc5d5bd9a 2024-07-04T03:00:09.130244351Z [2024-07-04T03:00:09.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T02:55:00+00:00, map_index=0, run_start_date=2024-07-04 03:00:07.645590+00:00, run_end_date=2024-07-04 03:00:08.054989+00:00, run_duration=0.409399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:00:05.987131+00:00, queued_by_job_id=2, pid=7623 2024-07-04T03:00:12.241341804Z [2024-07-04T03:00:12.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:00:12.241879764Z [2024-07-04T03:00:12.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 02:55:00+00:00, run_id=scheduled__2024-07-04T02:55:00+00:00, run_start_date=2024-07-04 03:00:00.334785+00:00, run_end_date=2024-07-04 03:00:12.241242+00:00, run_duration=11.906457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 02:55:00+00:00, data_interval_end=2024-07-04 03:00:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:00:12.249560763Z [2024-07-04T03:00:12.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:00:00+00:00, run_after=2024-07-04T03:05:00+00:00 2024-07-04T03:00:12.287246931Z [2024-07-04T03:00:12.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T02:55:00+00:00 exited with status success for try_number 1 2024-07-04T03:00:12.296683880Z [2024-07-04T03:00:12.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T02:55:00+00:00, map_index=-1, run_start_date=2024-07-04 03:00:10.760016+00:00, run_end_date=2024-07-04 03:00:11.126910+00:00, run_duration=0.366894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:00:08.998313+00:00, queued_by_job_id=2, pid=7635 2024-07-04T03:01:00.459780928Z [2024-07-04T03:01:00.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:01:00+00:00, run_after=2024-07-04T03:02:00+00:00 2024-07-04T03:01:00.474653031Z [2024-07-04T03:01:00.474+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:01:00.574160097Z [2024-07-04T03:01:00.573+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:01:00.574197376Z 2024-07-04T03:01:00.574205001Z 2024-07-04T03:01:00.574220885Z [2024-07-04T03:01:00.574+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:01:00.574239214Z [2024-07-04T03:01:00.574+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:01:00.574928451Z [2024-07-04T03:01:00.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:01:00.574948528Z 2024-07-04T03:01:00.574955817Z 2024-07-04T03:01:00.577999561Z [2024-07-04T03:01:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:01:00.578073644Z [2024-07-04T03:01:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:01:00.578255621Z [2024-07-04T03:01:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:01:00.578429291Z [2024-07-04T03:01:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:01:00.945110469Z [2024-07-04T03:01:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status queued for try_number 1 2024-07-04T03:01:00.945430284Z [2024-07-04T03:01:00.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status queued for try_number 1 2024-07-04T03:01:00.959857680Z [2024-07-04T03:01:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75c7a32d-b791-4ee2-8865-f018dfbf4e45 2024-07-04T03:01:00.960352122Z [2024-07-04T03:01:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13df7bcf-5622-4325-85ee-c42d2ccf6710 2024-07-04T03:01:04.201540817Z [2024-07-04T03:01:04.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:01:04.201953537Z [2024-07-04T03:01:04.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:00:00+00:00, run_id=scheduled__2024-07-04T03:00:00+00:00, run_start_date=2024-07-04 03:01:00.507980+00:00, run_end_date=2024-07-04 03:01:04.201439+00:00, run_duration=3.693459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:00:00+00:00, data_interval_end=2024-07-04 03:01:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:01:04.217620712Z [2024-07-04T03:01:04.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:01:00+00:00, run_after=2024-07-04T03:02:00+00:00 2024-07-04T03:01:04.264468962Z [2024-07-04T03:01:04.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status success for try_number 1 2024-07-04T03:01:04.271690344Z [2024-07-04T03:01:04.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:00:00+00:00, map_index=-1, run_start_date=2024-07-04 03:01:02.541329+00:00, run_end_date=2024-07-04 03:01:04.061422+00:00, run_duration=1.520093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:01:00.575434+00:00, queued_by_job_id=2, pid=7671 2024-07-04T03:01:06.265051186Z [2024-07-04T03:01:06.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:01:06.265716807Z [2024-07-04T03:01:06.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:00:00+00:00, run_id=scheduled__2024-07-04T03:00:00+00:00, run_start_date=2024-07-04 03:01:00.513067+00:00, run_end_date=2024-07-04 03:01:06.265168+00:00, run_duration=5.752101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:00:00+00:00, data_interval_end=2024-07-04 03:01:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:01:06.280532775Z [2024-07-04T03:01:06.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:01:00+00:00, run_after=2024-07-04T03:02:00+00:00 2024-07-04T03:01:06.332018976Z [2024-07-04T03:01:06.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status success for try_number 1 2024-07-04T03:01:06.340449561Z [2024-07-04T03:01:06.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:00:00+00:00, map_index=-1, run_start_date=2024-07-04 03:01:02.723417+00:00, run_end_date=2024-07-04 03:01:05.174180+00:00, run_duration=2.450763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:01:00.575434+00:00, queued_by_job_id=2, pid=7672 2024-07-04T03:01:22.213861108Z [2024-07-04T03:01:22.213+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:02:00.846507433Z [2024-07-04T03:02:00.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:02:00+00:00, run_after=2024-07-04T03:03:00+00:00 2024-07-04T03:02:00.854421381Z [2024-07-04T03:02:00.854+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:02:00.861770249Z [2024-07-04T03:02:00.861+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:02:00.926613380Z [2024-07-04T03:02:00.926+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:02:00.926657609Z 2024-07-04T03:02:00.926668571Z 2024-07-04T03:02:00.926677341Z 2024-07-04T03:02:00.926686711Z [2024-07-04T03:02:00.926+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:02:00.926695274Z [2024-07-04T03:02:00.926+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:02:00.926718414Z [2024-07-04T03:02:00.926+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:02:00.927381904Z [2024-07-04T03:02:00.927+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:02:00.927421817Z 2024-07-04T03:02:00.927431490Z 2024-07-04T03:02:00.927440157Z 2024-07-04T03:02:00.930948902Z [2024-07-04T03:02:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:02:00.931195721Z [2024-07-04T03:02:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:02:00.931213739Z [2024-07-04T03:02:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:02:00.931332551Z [2024-07-04T03:02:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:02:00.931461753Z [2024-07-04T03:02:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:02:00.931473987Z [2024-07-04T03:02:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:02:01.164425041Z [2024-07-04T03:02:01.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status queued for try_number 1 2024-07-04T03:02:01.164467945Z [2024-07-04T03:02:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:01:00+00:00 exited with status queued for try_number 1 2024-07-04T03:02:01.164539472Z [2024-07-04T03:02:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:01:00+00:00 exited with status queued for try_number 1 2024-07-04T03:02:01.176264851Z [2024-07-04T03:02:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 098856b5-a831-4f1b-81af-cae491750ef9 2024-07-04T03:02:01.176337778Z [2024-07-04T03:02:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff810fd6-6bde-471c-abe5-92d3ff10d9be 2024-07-04T03:02:01.176506420Z [2024-07-04T03:02:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to b88b357b-9b2d-47de-8842-3e6e8c75233c 2024-07-04T03:02:02.363849009Z [2024-07-04T03:02:02.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:02:02.365922882Z [2024-07-04T03:02:02.363+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:00:00+00:00, run_id=scheduled__2024-07-04T03:00:00+00:00, run_start_date=2024-07-04 03:02:00.873078+00:00, run_end_date=2024-07-04 03:02:02.363769+00:00, run_duration=1.490691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:00:00+00:00, data_interval_end=2024-07-04 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:02:02.377562003Z [2024-07-04T03:02:02.377+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:02:00+00:00, run_after=2024-07-04T03:04:00+00:00 2024-07-04T03:02:02.448053597Z [2024-07-04T03:02:02.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status success for try_number 1 2024-07-04T03:02:02.454332284Z [2024-07-04T03:02:02.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:00:00+00:00, map_index=-1, run_start_date=2024-07-04 03:02:01.649182+00:00, run_end_date=2024-07-04 03:02:02.046770+00:00, run_duration=0.397588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:02:00.928072+00:00, queued_by_job_id=2, pid=7707 2024-07-04T03:02:04.093593985Z [2024-07-04T03:02:04.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:02:04.094051859Z [2024-07-04T03:02:04.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:01:00+00:00, run_id=scheduled__2024-07-04T03:01:00+00:00, run_start_date=2024-07-04 03:02:00.874288+00:00, run_end_date=2024-07-04 03:02:04.093679+00:00, run_duration=3.219391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:01:00+00:00, data_interval_end=2024-07-04 03:02:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:02:04.104177152Z [2024-07-04T03:02:04.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:02:00+00:00, run_after=2024-07-04T03:03:00+00:00 2024-07-04T03:02:05.259738411Z [2024-07-04T03:02:05.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:01:00+00:00 exited with status success for try_number 1 2024-07-04T03:02:05.266817461Z [2024-07-04T03:02:05.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:01:00+00:00, map_index=-1, run_start_date=2024-07-04 03:02:02.694414+00:00, run_end_date=2024-07-04 03:02:04.046818+00:00, run_duration=1.352404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:02:00.928072+00:00, queued_by_job_id=2, pid=7737 2024-07-04T03:02:06.609740586Z [2024-07-04T03:02:06.609+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:02:06.610097475Z [2024-07-04T03:02:06.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:01:00+00:00, run_id=scheduled__2024-07-04T03:01:00+00:00, run_start_date=2024-07-04 03:02:00.875381+00:00, run_end_date=2024-07-04 03:02:06.609663+00:00, run_duration=5.734282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:01:00+00:00, data_interval_end=2024-07-04 03:02:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:02:06.618583091Z [2024-07-04T03:02:06.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:02:00+00:00, run_after=2024-07-04T03:03:00+00:00 2024-07-04T03:02:07.717825142Z [2024-07-04T03:02:07.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:01:00+00:00 exited with status success for try_number 1 2024-07-04T03:02:07.724637666Z [2024-07-04T03:02:07.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:01:00+00:00, map_index=-1, run_start_date=2024-07-04 03:02:02.943421+00:00, run_end_date=2024-07-04 03:02:06.535858+00:00, run_duration=3.592437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:02:00.928072+00:00, queued_by_job_id=2, pid=7738 2024-07-04T03:03:00.168047041Z [2024-07-04T03:03:00.167+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:03:00.182118486Z [2024-07-04T03:03:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:03:00+00:00, run_after=2024-07-04T03:04:00+00:00 2024-07-04T03:03:00.240956291Z [2024-07-04T03:03:00.240+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:03:00.240990212Z 2024-07-04T03:03:00.240994110Z 2024-07-04T03:03:00.241005873Z [2024-07-04T03:03:00.240+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:03:00.241140768Z [2024-07-04T03:03:00.240+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:03:00.241792458Z [2024-07-04T03:03:00.241+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:03:00.241803994Z 2024-07-04T03:03:00.241807777Z 2024-07-04T03:03:00.244815417Z [2024-07-04T03:03:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:03:00.245060914Z [2024-07-04T03:03:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:03:00.245331999Z [2024-07-04T03:03:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:03:00.245461708Z [2024-07-04T03:03:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:03:00.550953672Z [2024-07-04T03:03:00.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:02:00+00:00 exited with status queued for try_number 1 2024-07-04T03:03:00.553567589Z [2024-07-04T03:03:00.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:02:00+00:00 exited with status queued for try_number 1 2024-07-04T03:03:00.562057015Z [2024-07-04T03:03:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to bae39045-e610-45a1-bba7-72b1813e0407 2024-07-04T03:03:00.562164929Z [2024-07-04T03:03:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86dc3412-a6aa-4833-8f53-39398201d24e 2024-07-04T03:03:03.964491053Z [2024-07-04T03:03:03.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:03:03.964996092Z [2024-07-04T03:03:03.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:02:00+00:00, run_id=scheduled__2024-07-04T03:02:00+00:00, run_start_date=2024-07-04 03:03:00.192065+00:00, run_end_date=2024-07-04 03:03:03.964627+00:00, run_duration=3.772562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:02:00+00:00, data_interval_end=2024-07-04 03:03:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:03:03.975541247Z [2024-07-04T03:03:03.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:03:00+00:00, run_after=2024-07-04T03:04:00+00:00 2024-07-04T03:03:04.207270282Z [2024-07-04T03:03:04.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:02:00+00:00 exited with status success for try_number 1 2024-07-04T03:03:04.216984350Z [2024-07-04T03:03:04.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:02:00+00:00, map_index=-1, run_start_date=2024-07-04 03:03:02.482909+00:00, run_end_date=2024-07-04 03:03:03.875525+00:00, run_duration=1.392616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:03:00.242365+00:00, queued_by_job_id=2, pid=7793 2024-07-04T03:03:05.290543729Z [2024-07-04T03:03:05.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:03:05.290642292Z [2024-07-04T03:03:05.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:02:00+00:00, run_id=scheduled__2024-07-04T03:02:00+00:00, run_start_date=2024-07-04 03:03:00.193559+00:00, run_end_date=2024-07-04 03:03:05.290373+00:00, run_duration=5.096814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:02:00+00:00, data_interval_end=2024-07-04 03:03:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:03:05.299111947Z [2024-07-04T03:03:05.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:03:00+00:00, run_after=2024-07-04T03:04:00+00:00 2024-07-04T03:03:05.330348156Z [2024-07-04T03:03:05.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:02:00+00:00 exited with status success for try_number 1 2024-07-04T03:03:05.335800060Z [2024-07-04T03:03:05.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:02:00+00:00, map_index=-1, run_start_date=2024-07-04 03:03:02.416351+00:00, run_end_date=2024-07-04 03:03:04.278761+00:00, run_duration=1.86241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:03:00.242365+00:00, queued_by_job_id=2, pid=7792 2024-07-04T03:04:00.139814116Z [2024-07-04T03:04:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:04:00+00:00, run_after=2024-07-04T03:05:00+00:00 2024-07-04T03:04:00.147856499Z [2024-07-04T03:04:00.147+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:04:00.154076372Z [2024-07-04T03:04:00.153+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:04:00.233874470Z [2024-07-04T03:04:00.233+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:04:00.233901346Z 2024-07-04T03:04:00.233910032Z 2024-07-04T03:04:00.233913462Z 2024-07-04T03:04:00.234234938Z [2024-07-04T03:04:00.233+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:04:00.234542771Z [2024-07-04T03:04:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:04:00.234749845Z [2024-07-04T03:04:00.234+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:04:00.235648988Z [2024-07-04T03:04:00.235+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:04:00.235664757Z 2024-07-04T03:04:00.235670790Z 2024-07-04T03:04:00.235696165Z 2024-07-04T03:04:00.240734875Z [2024-07-04T03:04:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:04:00.241121730Z [2024-07-04T03:04:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:04:00.241460756Z [2024-07-04T03:04:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:04:00.241679012Z [2024-07-04T03:04:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:04:00.242010292Z [2024-07-04T03:04:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:04:00.242215304Z [2024-07-04T03:04:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:04:00.483524934Z [2024-07-04T03:04:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:02:00+00:00 exited with status queued for try_number 1 2024-07-04T03:04:00.483944099Z [2024-07-04T03:04:00.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:03:00+00:00 exited with status queued for try_number 1 2024-07-04T03:04:00.484191735Z [2024-07-04T03:04:00.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:03:00+00:00 exited with status queued for try_number 1 2024-07-04T03:04:00.497883614Z [2024-07-04T03:04:00.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to af29e1b7-ca5c-4b54-ad01-568ebdd437f5 2024-07-04T03:04:00.498328849Z [2024-07-04T03:04:00.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8642609-d5ff-4c5b-81df-9e4c22eff864 2024-07-04T03:04:00.498657935Z [2024-07-04T03:04:00.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7b96606-ec27-4735-a5a3-4516e2081b1b 2024-07-04T03:04:03.012892791Z [2024-07-04T03:04:03.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:04:03.013257280Z [2024-07-04T03:04:03.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:02:00+00:00, run_id=scheduled__2024-07-04T03:02:00+00:00, run_start_date=2024-07-04 03:04:00.163056+00:00, run_end_date=2024-07-04 03:04:03.012738+00:00, run_duration=2.849682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:02:00+00:00, data_interval_end=2024-07-04 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:04:03.023574126Z [2024-07-04T03:04:03.023+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:04:00+00:00, run_after=2024-07-04T03:06:00+00:00 2024-07-04T03:04:03.081565279Z [2024-07-04T03:04:03.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:02:00+00:00 exited with status success for try_number 1 2024-07-04T03:04:03.087627847Z [2024-07-04T03:04:03.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:02:00+00:00, map_index=-1, run_start_date=2024-07-04 03:04:01.529433+00:00, run_end_date=2024-07-04 03:04:02.028768+00:00, run_duration=0.499335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:04:00.236769+00:00, queued_by_job_id=2, pid=7829 2024-07-04T03:04:04.137055278Z [2024-07-04T03:04:04.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:04:04.137489123Z [2024-07-04T03:04:04.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:03:00+00:00, run_id=scheduled__2024-07-04T03:03:00+00:00, run_start_date=2024-07-04 03:04:00.164734+00:00, run_end_date=2024-07-04 03:04:04.136959+00:00, run_duration=3.972225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:03:00+00:00, data_interval_end=2024-07-04 03:04:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:04:04.148424054Z [2024-07-04T03:04:04.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:04:00+00:00, run_after=2024-07-04T03:05:00+00:00 2024-07-04T03:04:04.198330421Z [2024-07-04T03:04:04.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:03:00+00:00 exited with status success for try_number 1 2024-07-04T03:04:04.205051033Z [2024-07-04T03:04:04.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:03:00+00:00, map_index=-1, run_start_date=2024-07-04 03:04:02.407449+00:00, run_end_date=2024-07-04 03:04:03.751678+00:00, run_duration=1.344229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:04:00.236769+00:00, queued_by_job_id=2, pid=7858 2024-07-04T03:04:05.250360426Z [2024-07-04T03:04:05.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:04:05.250849561Z [2024-07-04T03:04:05.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:03:00+00:00, run_id=scheduled__2024-07-04T03:03:00+00:00, run_start_date=2024-07-04 03:04:00.165843+00:00, run_end_date=2024-07-04 03:04:05.250222+00:00, run_duration=5.084379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:03:00+00:00, data_interval_end=2024-07-04 03:04:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:04:05.260039480Z [2024-07-04T03:04:05.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:04:00+00:00, run_after=2024-07-04T03:05:00+00:00 2024-07-04T03:04:05.295261140Z [2024-07-04T03:04:05.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:03:00+00:00 exited with status success for try_number 1 2024-07-04T03:04:05.302734133Z [2024-07-04T03:04:05.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:03:00+00:00, map_index=-1, run_start_date=2024-07-04 03:04:02.517758+00:00, run_end_date=2024-07-04 03:04:04.329229+00:00, run_duration=1.811471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:04:00.236769+00:00, queued_by_job_id=2, pid=7859 2024-07-04T03:05:01.099104710Z [2024-07-04T03:05:01.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:05:00+00:00, run_after=2024-07-04T03:10:00+00:00 2024-07-04T03:05:01.117317678Z [2024-07-04T03:05:01.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:05:00+00:00, run_after=2024-07-04T03:06:00+00:00 2024-07-04T03:05:01.129378325Z [2024-07-04T03:05:01.128+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:05:01.244514264Z [2024-07-04T03:05:01.244+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:05:01.244587806Z 2024-07-04T03:05:01.244596632Z 2024-07-04T03:05:01.244602873Z 2024-07-04T03:05:01.244689890Z [2024-07-04T03:05:01.244+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:05:01.244766099Z [2024-07-04T03:05:01.244+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:05:01.245142332Z [2024-07-04T03:05:01.244+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:05:01.246009086Z [2024-07-04T03:05:01.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:05:01.246025703Z 2024-07-04T03:05:01.246054680Z 2024-07-04T03:05:01.246081424Z 2024-07-04T03:05:01.252710917Z [2024-07-04T03:05:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:05:01.252854639Z [2024-07-04T03:05:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:05:01.253242133Z [2024-07-04T03:05:01.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:05:01.253529047Z [2024-07-04T03:05:01.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:05:01.254159648Z [2024-07-04T03:05:01.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:05:01.254411205Z [2024-07-04T03:05:01.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:05:01.543112498Z [2024-07-04T03:05:01.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status queued for try_number 1 2024-07-04T03:05:01.543238944Z [2024-07-04T03:05:01.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:04:00+00:00 exited with status queued for try_number 1 2024-07-04T03:05:01.543279332Z [2024-07-04T03:05:01.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:04:00+00:00 exited with status queued for try_number 1 2024-07-04T03:05:01.557290052Z [2024-07-04T03:05:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to d063c5d2-46d9-470f-b9c3-3e42de74245b 2024-07-04T03:05:01.557377032Z [2024-07-04T03:05:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 766e4c2e-b4a8-445f-b1ce-0318e69cee1a 2024-07-04T03:05:01.557992833Z [2024-07-04T03:05:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f199e59-5967-4d58-912b-363c145ada46 2024-07-04T03:05:03.999057022Z [2024-07-04T03:05:03.998+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:05:03.999115877Z 2024-07-04T03:05:03.999207933Z [2024-07-04T03:05:03.999+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:05:03.999982423Z [2024-07-04T03:05:03.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:05:03.999998344Z 2024-07-04T03:05:04.006548844Z [2024-07-04T03:05:04.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:05:04.006709229Z [2024-07-04T03:05:04.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:05:04.070224607Z [2024-07-04T03:05:04.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status queued for try_number 1 2024-07-04T03:05:04.070392511Z [2024-07-04T03:05:04.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status success for try_number 1 2024-07-04T03:05:04.076681946Z [2024-07-04T03:05:04.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7235184f-e1d0-4b61-bc03-b02297b2f8e6 2024-07-04T03:05:04.077043036Z [2024-07-04T03:05:04.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:00:00+00:00, map_index=-1, run_start_date=2024-07-04 03:05:03.239238+00:00, run_end_date=2024-07-04 03:05:03.646213+00:00, run_duration=0.406975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:05:01.247111+00:00, queued_by_job_id=2, pid=7925 2024-07-04T03:05:05.285449596Z [2024-07-04T03:05:05.284+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:05:05.285594938Z [2024-07-04T03:05:05.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:04:00+00:00, run_id=scheduled__2024-07-04T03:04:00+00:00, run_start_date=2024-07-04 03:05:01.149967+00:00, run_end_date=2024-07-04 03:05:05.285286+00:00, run_duration=4.135319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:04:00+00:00, data_interval_end=2024-07-04 03:05:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:05:05.295637960Z [2024-07-04T03:05:05.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:05:00+00:00, run_after=2024-07-04T03:06:00+00:00 2024-07-04T03:05:05.303490372Z [2024-07-04T03:05:05.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:05:05.303832906Z [2024-07-04T03:05:05.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:04:00+00:00, run_id=scheduled__2024-07-04T03:04:00+00:00, run_start_date=2024-07-04 03:05:01.151865+00:00, run_end_date=2024-07-04 03:05:05.303363+00:00, run_duration=4.151498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:04:00+00:00, data_interval_end=2024-07-04 03:05:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:05:05.314984117Z [2024-07-04T03:05:05.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:05:00+00:00, run_after=2024-07-04T03:06:00+00:00 2024-07-04T03:05:05.381506905Z [2024-07-04T03:05:05.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:04:00+00:00 exited with status success for try_number 1 2024-07-04T03:05:05.381662855Z [2024-07-04T03:05:05.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:04:00+00:00 exited with status success for try_number 1 2024-07-04T03:05:05.389446637Z [2024-07-04T03:05:05.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:04:00+00:00, map_index=-1, run_start_date=2024-07-04 03:05:03.184737+00:00, run_end_date=2024-07-04 03:05:04.542695+00:00, run_duration=1.357958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:05:01.247111+00:00, queued_by_job_id=2, pid=7924 2024-07-04T03:05:05.389583984Z [2024-07-04T03:05:05.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:04:00+00:00, map_index=-1, run_start_date=2024-07-04 03:05:03.331081+00:00, run_end_date=2024-07-04 03:05:05.142093+00:00, run_duration=1.811012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:05:01.247111+00:00, queued_by_job_id=2, pid=7926 2024-07-04T03:05:06.649008487Z [2024-07-04T03:05:06.648+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:05:06.649060417Z 2024-07-04T03:05:06.649265584Z [2024-07-04T03:05:06.648+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:05:06.650242014Z [2024-07-04T03:05:06.649+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:05:06.650266871Z 2024-07-04T03:05:06.653391592Z [2024-07-04T03:05:06.652+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:05:06.653672371Z [2024-07-04T03:05:06.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:05:06.721233875Z [2024-07-04T03:05:06.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status queued for try_number 1 2024-07-04T03:05:06.721257923Z [2024-07-04T03:05:06.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status success for try_number 1 2024-07-04T03:05:06.736425042Z [2024-07-04T03:05:06.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e2355ad-15b6-49c6-9059-397e909a55c5 2024-07-04T03:05:06.736450565Z [2024-07-04T03:05:06.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:00:00+00:00, map_index=-1, run_start_date=2024-07-04 03:05:05.884467+00:00, run_end_date=2024-07-04 03:05:06.307924+00:00, run_duration=0.423457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:05:04.000476+00:00, queued_by_job_id=2, pid=7965 2024-07-04T03:05:10.098986977Z [2024-07-04T03:05:10.098+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:05:10.099080787Z 2024-07-04T03:05:10.099238343Z [2024-07-04T03:05:10.098+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:05:10.099977236Z [2024-07-04T03:05:10.099+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:05:10.099989185Z 2024-07-04T03:05:10.103189734Z [2024-07-04T03:05:10.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:05:10.103411953Z [2024-07-04T03:05:10.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:05:10.173372761Z [2024-07-04T03:05:10.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status queued for try_number 1 2024-07-04T03:05:10.173530699Z [2024-07-04T03:05:10.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status success for try_number 1 2024-07-04T03:05:10.180124402Z [2024-07-04T03:05:10.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 512fad52-2756-42eb-a95c-530de7c6c75d 2024-07-04T03:05:10.180337504Z [2024-07-04T03:05:10.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:00:00+00:00, map_index=0, run_start_date=2024-07-04 03:05:08.289351+00:00, run_end_date=2024-07-04 03:05:09.661844+00:00, run_duration=1.372493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:05:06.650726+00:00, queued_by_job_id=2, pid=7977 2024-07-04T03:05:12.950430391Z [2024-07-04T03:05:12.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:05:12.950947602Z [2024-07-04T03:05:12.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:00:00+00:00, run_id=scheduled__2024-07-04T03:00:00+00:00, run_start_date=2024-07-04 03:05:01.148015+00:00, run_end_date=2024-07-04 03:05:12.950431+00:00, run_duration=11.802416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:00:00+00:00, data_interval_end=2024-07-04 03:05:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:05:12.958117336Z [2024-07-04T03:05:12.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:05:00+00:00, run_after=2024-07-04T03:10:00+00:00 2024-07-04T03:05:13.005455362Z [2024-07-04T03:05:13.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:00:00+00:00 exited with status success for try_number 1 2024-07-04T03:05:13.015228123Z [2024-07-04T03:05:13.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:00:00+00:00, map_index=-1, run_start_date=2024-07-04 03:05:11.995864+00:00, run_end_date=2024-07-04 03:05:12.502697+00:00, run_duration=0.506833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:05:10.100404+00:00, queued_by_job_id=2, pid=7998 2024-07-04T03:06:00.441031003Z [2024-07-04T03:06:00.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:06:00+00:00, run_after=2024-07-04T03:07:00+00:00 2024-07-04T03:06:00.451238731Z [2024-07-04T03:06:00.450+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:06:00.457745830Z [2024-07-04T03:06:00.457+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:06:00.529457603Z [2024-07-04T03:06:00.529+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:06:00.529483948Z 2024-07-04T03:06:00.529518869Z 2024-07-04T03:06:00.529522704Z 2024-07-04T03:06:00.529603233Z [2024-07-04T03:06:00.529+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:06:00.529726279Z [2024-07-04T03:06:00.529+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:06:00.529832280Z [2024-07-04T03:06:00.529+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:06:00.530551066Z [2024-07-04T03:06:00.530+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:06:00.530567901Z 2024-07-04T03:06:00.530571967Z 2024-07-04T03:06:00.530575146Z 2024-07-04T03:06:00.534098425Z [2024-07-04T03:06:00.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:06:00.534272116Z [2024-07-04T03:06:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:06:00.534726340Z [2024-07-04T03:06:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:06:00.534855409Z [2024-07-04T03:06:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:06:00.535109504Z [2024-07-04T03:06:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:06:00.535199448Z [2024-07-04T03:06:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:06:00.934005860Z [2024-07-04T03:06:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:04:00+00:00 exited with status queued for try_number 1 2024-07-04T03:06:00.934571542Z [2024-07-04T03:06:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status queued for try_number 1 2024-07-04T03:06:00.935171631Z [2024-07-04T03:06:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status queued for try_number 1 2024-07-04T03:06:00.963432032Z [2024-07-04T03:06:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to f03f0f21-0147-4784-ba6f-5ddb5af6664e 2024-07-04T03:06:00.963701958Z [2024-07-04T03:06:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f64e350-18d5-4c21-80a6-0018f3b725ad 2024-07-04T03:06:00.963879375Z [2024-07-04T03:06:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab7eec7a-f621-4186-80e5-4aa9e36b44ea 2024-07-04T03:06:02.701116573Z [2024-07-04T03:06:02.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:06:02.701289020Z [2024-07-04T03:06:02.701+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:04:00+00:00, run_id=scheduled__2024-07-04T03:04:00+00:00, run_start_date=2024-07-04 03:06:00.469515+00:00, run_end_date=2024-07-04 03:06:02.701007+00:00, run_duration=2.231492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:04:00+00:00, data_interval_end=2024-07-04 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:06:02.709002053Z [2024-07-04T03:06:02.708+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:06:00+00:00, run_after=2024-07-04T03:08:00+00:00 2024-07-04T03:06:02.755633976Z [2024-07-04T03:06:02.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:04:00+00:00 exited with status success for try_number 1 2024-07-04T03:06:02.761085673Z [2024-07-04T03:06:02.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:04:00+00:00, map_index=-1, run_start_date=2024-07-04 03:06:02.017009+00:00, run_end_date=2024-07-04 03:06:02.473618+00:00, run_duration=0.456609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:06:00.531336+00:00, queued_by_job_id=2, pid=8015 2024-07-04T03:06:04.927249981Z [2024-07-04T03:06:04.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:06:04.927632627Z [2024-07-04T03:06:04.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:05:00+00:00, run_id=scheduled__2024-07-04T03:05:00+00:00, run_start_date=2024-07-04 03:06:00.471256+00:00, run_end_date=2024-07-04 03:06:04.927128+00:00, run_duration=4.455872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:05:00+00:00, data_interval_end=2024-07-04 03:06:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:06:04.936011799Z [2024-07-04T03:06:04.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:06:00+00:00, run_after=2024-07-04T03:07:00+00:00 2024-07-04T03:06:04.989595372Z [2024-07-04T03:06:04.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status success for try_number 1 2024-07-04T03:06:04.989944735Z [2024-07-04T03:06:04.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status success for try_number 1 2024-07-04T03:06:04.997130452Z [2024-07-04T03:06:04.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:05:00+00:00, map_index=-1, run_start_date=2024-07-04 03:06:03.130975+00:00, run_end_date=2024-07-04 03:06:04.824962+00:00, run_duration=1.693987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:06:00.531336+00:00, queued_by_job_id=2, pid=8046 2024-07-04T03:06:04.997413198Z [2024-07-04T03:06:04.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:05:00+00:00, map_index=-1, run_start_date=2024-07-04 03:06:03.083667+00:00, run_end_date=2024-07-04 03:06:04.351128+00:00, run_duration=1.267461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:06:00.531336+00:00, queued_by_job_id=2, pid=8045 2024-07-04T03:06:06.060526185Z [2024-07-04T03:06:06.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:06:06.061087862Z [2024-07-04T03:06:06.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:05:00+00:00, run_id=scheduled__2024-07-04T03:05:00+00:00, run_start_date=2024-07-04 03:06:00.472553+00:00, run_end_date=2024-07-04 03:06:06.060380+00:00, run_duration=5.587827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:05:00+00:00, data_interval_end=2024-07-04 03:06:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:06:06.074140238Z [2024-07-04T03:06:06.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:06:00+00:00, run_after=2024-07-04T03:07:00+00:00 2024-07-04T03:06:22.284255425Z [2024-07-04T03:06:22.283+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:07:00.661162153Z [2024-07-04T03:07:00.660+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:07:00.688620539Z [2024-07-04T03:07:00.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:07:00+00:00, run_after=2024-07-04T03:08:00+00:00 2024-07-04T03:07:00.778250914Z [2024-07-04T03:07:00.777+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:07:00.778287537Z 2024-07-04T03:07:00.778291976Z 2024-07-04T03:07:00.778323350Z [2024-07-04T03:07:00.778+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:07:00.778411232Z [2024-07-04T03:07:00.778+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:07:00.779245923Z [2024-07-04T03:07:00.779+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:07:00.779262344Z 2024-07-04T03:07:00.779284769Z 2024-07-04T03:07:00.782916281Z [2024-07-04T03:07:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:07:00.783130019Z [2024-07-04T03:07:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:07:00.783399887Z [2024-07-04T03:07:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:07:00.783503148Z [2024-07-04T03:07:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:07:01.180786935Z [2024-07-04T03:07:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:06:00+00:00 exited with status queued for try_number 1 2024-07-04T03:07:01.180874278Z [2024-07-04T03:07:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:06:00+00:00 exited with status queued for try_number 1 2024-07-04T03:07:01.199378754Z [2024-07-04T03:07:01.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce2c39a6-3b8d-4a2d-96e5-a5c56a5733f5 2024-07-04T03:07:01.199416853Z [2024-07-04T03:07:01.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to 046ba2d7-4a8e-4e19-a98b-114800be5a1c 2024-07-04T03:07:04.773085659Z [2024-07-04T03:07:04.772+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:07:04.773577946Z [2024-07-04T03:07:04.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:06:00+00:00, run_id=scheduled__2024-07-04T03:06:00+00:00, run_start_date=2024-07-04 03:07:00.715775+00:00, run_end_date=2024-07-04 03:07:04.772950+00:00, run_duration=4.057175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:06:00+00:00, data_interval_end=2024-07-04 03:07:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:07:04.782988797Z [2024-07-04T03:07:04.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:07:00+00:00, run_after=2024-07-04T03:08:00+00:00 2024-07-04T03:07:04.826993309Z [2024-07-04T03:07:04.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:06:00+00:00 exited with status success for try_number 1 2024-07-04T03:07:04.832419218Z [2024-07-04T03:07:04.832+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:06:00+00:00, map_index=-1, run_start_date=2024-07-04 03:07:02.942308+00:00, run_end_date=2024-07-04 03:07:04.409526+00:00, run_duration=1.467218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:07:00.779931+00:00, queued_by_job_id=2, pid=8100 2024-07-04T03:07:05.900780076Z [2024-07-04T03:07:05.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:07:05.901366337Z [2024-07-04T03:07:05.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:06:00+00:00, run_id=scheduled__2024-07-04T03:06:00+00:00, run_start_date=2024-07-04 03:07:00.718320+00:00, run_end_date=2024-07-04 03:07:05.900589+00:00, run_duration=5.182269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:06:00+00:00, data_interval_end=2024-07-04 03:07:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:07:05.916321772Z [2024-07-04T03:07:05.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:07:00+00:00, run_after=2024-07-04T03:08:00+00:00 2024-07-04T03:07:05.973509482Z [2024-07-04T03:07:05.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:06:00+00:00 exited with status success for try_number 1 2024-07-04T03:07:05.982391418Z [2024-07-04T03:07:05.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:06:00+00:00, map_index=-1, run_start_date=2024-07-04 03:07:03.190488+00:00, run_end_date=2024-07-04 03:07:05.650558+00:00, run_duration=2.46007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:07:00.779931+00:00, queued_by_job_id=2, pid=8101 2024-07-04T03:08:00.603993700Z [2024-07-04T03:08:00.603+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:08:00.611131653Z [2024-07-04T03:08:00.610+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:08:00.622745071Z [2024-07-04T03:08:00.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:08:00+00:00, run_after=2024-07-04T03:09:00+00:00 2024-07-04T03:08:00.684939055Z [2024-07-04T03:08:00.684+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:08:00.684966431Z 2024-07-04T03:08:00.684971177Z 2024-07-04T03:08:00.684974500Z 2024-07-04T03:08:00.684985739Z [2024-07-04T03:08:00.684+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:08:00.685049473Z [2024-07-04T03:08:00.684+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:08:00.685126228Z [2024-07-04T03:08:00.685+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:08:00.685811614Z [2024-07-04T03:08:00.685+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:08:00.685817080Z 2024-07-04T03:08:00.685820268Z 2024-07-04T03:08:00.685823302Z 2024-07-04T03:08:00.691675362Z [2024-07-04T03:08:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:08:00.691741206Z [2024-07-04T03:08:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:08:00.691957551Z [2024-07-04T03:08:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:08:00.692023300Z [2024-07-04T03:08:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:08:00.692281194Z [2024-07-04T03:08:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:08:00.692358576Z [2024-07-04T03:08:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:08:01.202314456Z [2024-07-04T03:08:01.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:06:00+00:00 exited with status queued for try_number 1 2024-07-04T03:08:01.202586773Z [2024-07-04T03:08:01.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:07:00+00:00 exited with status queued for try_number 1 2024-07-04T03:08:01.202761443Z [2024-07-04T03:08:01.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:07:00+00:00 exited with status queued for try_number 1 2024-07-04T03:08:01.214547215Z [2024-07-04T03:08:01.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 634f609c-7a72-4394-b95d-07eeb09e8dac 2024-07-04T03:08:01.214823145Z [2024-07-04T03:08:01.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1128fbd-0808-4958-a89c-994af913615a 2024-07-04T03:08:01.215075474Z [2024-07-04T03:08:01.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c7a6a69-0fa2-4003-909e-eea5ef1a0eeb 2024-07-04T03:08:03.120913459Z [2024-07-04T03:08:03.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:08:03.121368345Z [2024-07-04T03:08:03.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:06:00+00:00, run_id=scheduled__2024-07-04T03:06:00+00:00, run_start_date=2024-07-04 03:08:00.633609+00:00, run_end_date=2024-07-04 03:08:03.120960+00:00, run_duration=2.487351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:06:00+00:00, data_interval_end=2024-07-04 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:08:03.130120127Z [2024-07-04T03:08:03.129+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:08:00+00:00, run_after=2024-07-04T03:10:00+00:00 2024-07-04T03:08:03.193677680Z [2024-07-04T03:08:03.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:06:00+00:00 exited with status success for try_number 1 2024-07-04T03:08:03.200215335Z [2024-07-04T03:08:03.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:06:00+00:00, map_index=-1, run_start_date=2024-07-04 03:08:01.997415+00:00, run_end_date=2024-07-04 03:08:02.507433+00:00, run_duration=0.510018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:08:00.687001+00:00, queued_by_job_id=2, pid=8136 2024-07-04T03:08:05.798166861Z [2024-07-04T03:08:05.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:08:05.798343935Z [2024-07-04T03:08:05.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:07:00+00:00, run_id=scheduled__2024-07-04T03:07:00+00:00, run_start_date=2024-07-04 03:08:00.636287+00:00, run_end_date=2024-07-04 03:08:05.798066+00:00, run_duration=5.161779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:07:00+00:00, data_interval_end=2024-07-04 03:08:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:08:05.812221060Z [2024-07-04T03:08:05.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:08:00+00:00, run_after=2024-07-04T03:09:00+00:00 2024-07-04T03:08:05.820166111Z [2024-07-04T03:08:05.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:08:05.820389655Z [2024-07-04T03:08:05.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:07:00+00:00, run_id=scheduled__2024-07-04T03:07:00+00:00, run_start_date=2024-07-04 03:08:00.634951+00:00, run_end_date=2024-07-04 03:08:05.820063+00:00, run_duration=5.185112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:07:00+00:00, data_interval_end=2024-07-04 03:08:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:08:05.831737538Z [2024-07-04T03:08:05.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:08:00+00:00, run_after=2024-07-04T03:09:00+00:00 2024-07-04T03:08:05.862345879Z [2024-07-04T03:08:05.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:07:00+00:00 exited with status success for try_number 1 2024-07-04T03:08:05.862390608Z [2024-07-04T03:08:05.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:07:00+00:00 exited with status success for try_number 1 2024-07-04T03:08:05.871349923Z [2024-07-04T03:08:05.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:07:00+00:00, map_index=-1, run_start_date=2024-07-04 03:08:03.012773+00:00, run_end_date=2024-07-04 03:08:04.698443+00:00, run_duration=1.68567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:08:00.687001+00:00, queued_by_job_id=2, pid=8156 2024-07-04T03:08:05.871497186Z [2024-07-04T03:08:05.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:07:00+00:00, map_index=-1, run_start_date=2024-07-04 03:08:03.425839+00:00, run_end_date=2024-07-04 03:08:05.428311+00:00, run_duration=2.002472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:08:00.687001+00:00, queued_by_job_id=2, pid=8175 2024-07-04T03:09:00.503996159Z [2024-07-04T03:09:00.503+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:09:00.516731635Z [2024-07-04T03:09:00.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:09:00+00:00, run_after=2024-07-04T03:10:00+00:00 2024-07-04T03:09:00.566458138Z [2024-07-04T03:09:00.565+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:09:00.566484491Z 2024-07-04T03:09:00.566489659Z 2024-07-04T03:09:00.566494278Z [2024-07-04T03:09:00.565+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:09:00.566517787Z [2024-07-04T03:09:00.565+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:09:00.566990913Z [2024-07-04T03:09:00.566+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:09:00.567010752Z 2024-07-04T03:09:00.567015932Z 2024-07-04T03:09:00.570337745Z [2024-07-04T03:09:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:09:00.570486509Z [2024-07-04T03:09:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:09:00.570760579Z [2024-07-04T03:09:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:09:00.570853407Z [2024-07-04T03:09:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:09:00.844748141Z [2024-07-04T03:09:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:08:00+00:00 exited with status queued for try_number 1 2024-07-04T03:09:00.844793887Z [2024-07-04T03:09:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:08:00+00:00 exited with status queued for try_number 1 2024-07-04T03:09:00.860047213Z [2024-07-04T03:09:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to c91ad221-bd44-4409-b850-925ebe42fb65 2024-07-04T03:09:00.860179268Z [2024-07-04T03:09:00.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to eca4c258-fff4-4a7e-957f-d4289a59d652 2024-07-04T03:09:04.762448111Z [2024-07-04T03:09:04.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:09:04.762484509Z [2024-07-04T03:09:04.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:08:00+00:00, run_id=scheduled__2024-07-04T03:08:00+00:00, run_start_date=2024-07-04 03:09:00.527035+00:00, run_end_date=2024-07-04 03:09:04.749374+00:00, run_duration=4.222339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:08:00+00:00, data_interval_end=2024-07-04 03:09:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:09:04.762491273Z [2024-07-04T03:09:04.757+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:09:00+00:00, run_after=2024-07-04T03:10:00+00:00 2024-07-04T03:09:04.810019937Z [2024-07-04T03:09:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:08:00+00:00 exited with status success for try_number 1 2024-07-04T03:09:04.815082703Z [2024-07-04T03:09:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:08:00+00:00, map_index=-1, run_start_date=2024-07-04 03:09:02.573027+00:00, run_end_date=2024-07-04 03:09:04.359277+00:00, run_duration=1.78625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:09:00.567501+00:00, queued_by_job_id=2, pid=8220 2024-07-04T03:09:05.863358984Z [2024-07-04T03:09:05.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:09:05.863573045Z [2024-07-04T03:09:05.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:08:00+00:00, run_id=scheduled__2024-07-04T03:08:00+00:00, run_start_date=2024-07-04 03:09:00.528660+00:00, run_end_date=2024-07-04 03:09:05.863111+00:00, run_duration=5.334451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:08:00+00:00, data_interval_end=2024-07-04 03:09:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:09:05.873331968Z [2024-07-04T03:09:05.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:09:00+00:00, run_after=2024-07-04T03:10:00+00:00 2024-07-04T03:09:05.909714570Z [2024-07-04T03:09:05.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:08:00+00:00 exited with status success for try_number 1 2024-07-04T03:09:05.917337974Z [2024-07-04T03:09:05.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:08:00+00:00, map_index=-1, run_start_date=2024-07-04 03:09:02.780954+00:00, run_end_date=2024-07-04 03:09:05.422133+00:00, run_duration=2.641179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:09:00.567501+00:00, queued_by_job_id=2, pid=8221 2024-07-04T03:10:01.003861295Z [2024-07-04T03:10:01.003+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:10:00+00:00, run_after=2024-07-04T03:15:00+00:00 2024-07-04T03:10:01.013976455Z [2024-07-04T03:10:01.013+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:10:01.028686166Z [2024-07-04T03:10:01.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:10:00+00:00, run_after=2024-07-04T03:11:00+00:00 2024-07-04T03:10:01.039587476Z [2024-07-04T03:10:01.039+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:10:01.174266065Z [2024-07-04T03:10:01.173+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T03:10:01.174312413Z 2024-07-04T03:10:01.174323010Z 2024-07-04T03:10:01.174333329Z 2024-07-04T03:10:01.174342831Z 2024-07-04T03:10:01.174911833Z [2024-07-04T03:10:01.174+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:10:01.175320189Z [2024-07-04T03:10:01.175+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:10:01.175632509Z [2024-07-04T03:10:01.175+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:10:01.175951240Z [2024-07-04T03:10:01.175+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:10:01.177090048Z [2024-07-04T03:10:01.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:10:01.177124491Z 2024-07-04T03:10:01.177135554Z 2024-07-04T03:10:01.177145131Z 2024-07-04T03:10:01.177154014Z 2024-07-04T03:10:01.182338860Z [2024-07-04T03:10:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:10:01.182593907Z [2024-07-04T03:10:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:10:01.182985160Z [2024-07-04T03:10:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:10:01.183197736Z [2024-07-04T03:10:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:10:01.183688437Z [2024-07-04T03:10:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:10:01.183971919Z [2024-07-04T03:10:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:10:01.184380906Z [2024-07-04T03:10:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:10:01.184618850Z [2024-07-04T03:10:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:10:01.627957982Z [2024-07-04T03:10:01.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status queued for try_number 1 2024-07-04T03:10:01.628266461Z [2024-07-04T03:10:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:08:00+00:00 exited with status queued for try_number 1 2024-07-04T03:10:01.628413193Z [2024-07-04T03:10:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:09:00+00:00 exited with status queued for try_number 1 2024-07-04T03:10:01.628552162Z [2024-07-04T03:10:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:09:00+00:00 exited with status queued for try_number 1 2024-07-04T03:10:01.640746145Z [2024-07-04T03:10:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b03e8f2-ba2d-4216-b74d-c0604246bf78 2024-07-04T03:10:01.643374463Z [2024-07-04T03:10:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf5051c3-b199-4282-a1a8-004e3787a1db 2024-07-04T03:10:01.643517967Z [2024-07-04T03:10:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68f9118a-67c5-4514-994b-e03fd9d3223e 2024-07-04T03:10:01.643669125Z [2024-07-04T03:10:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09847fea-dad8-4f4f-8b06-06c4e362559e 2024-07-04T03:10:02.867850365Z [2024-07-04T03:10:02.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:10:02.868185899Z [2024-07-04T03:10:02.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:08:00+00:00, run_id=scheduled__2024-07-04T03:08:00+00:00, run_start_date=2024-07-04 03:10:01.059334+00:00, run_end_date=2024-07-04 03:10:02.867803+00:00, run_duration=1.808469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:08:00+00:00, data_interval_end=2024-07-04 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:10:02.876781825Z [2024-07-04T03:10:02.876+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:10:00+00:00, run_after=2024-07-04T03:12:00+00:00 2024-07-04T03:10:02.921974377Z [2024-07-04T03:10:02.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:08:00+00:00 exited with status success for try_number 1 2024-07-04T03:10:02.928943793Z [2024-07-04T03:10:02.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:08:00+00:00, map_index=-1, run_start_date=2024-07-04 03:10:02.171552+00:00, run_end_date=2024-07-04 03:10:02.598213+00:00, run_duration=0.426661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:10:01.178786+00:00, queued_by_job_id=2, pid=8257 2024-07-04T03:10:04.043816996Z [2024-07-04T03:10:04.043+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:10:04.043885842Z 2024-07-04T03:10:04.044117829Z [2024-07-04T03:10:04.043+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:10:04.044742249Z [2024-07-04T03:10:04.044+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:10:04.044755073Z 2024-07-04T03:10:04.047286471Z [2024-07-04T03:10:04.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:10:04.047555557Z [2024-07-04T03:10:04.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:10:04.111226343Z [2024-07-04T03:10:04.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status queued for try_number 1 2024-07-04T03:10:04.111276147Z [2024-07-04T03:10:04.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status success for try_number 1 2024-07-04T03:10:04.120757295Z [2024-07-04T03:10:04.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to 791a7426-6d9d-4934-af5f-5be269a5dba1 2024-07-04T03:10:04.120993637Z [2024-07-04T03:10:04.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:05:00+00:00, map_index=-1, run_start_date=2024-07-04 03:10:03.345239+00:00, run_end_date=2024-07-04 03:10:03.746955+00:00, run_duration=0.401716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:10:01.178786+00:00, queued_by_job_id=2, pid=8298 2024-07-04T03:10:05.299421325Z [2024-07-04T03:10:05.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:10:05.299827023Z [2024-07-04T03:10:05.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:09:00+00:00, run_id=scheduled__2024-07-04T03:09:00+00:00, run_start_date=2024-07-04 03:10:01.060646+00:00, run_end_date=2024-07-04 03:10:05.299254+00:00, run_duration=4.238608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:09:00+00:00, data_interval_end=2024-07-04 03:10:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:10:05.311906979Z [2024-07-04T03:10:05.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:10:00+00:00, run_after=2024-07-04T03:11:00+00:00 2024-07-04T03:10:05.321574919Z [2024-07-04T03:10:05.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:10:05.321712704Z [2024-07-04T03:10:05.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:09:00+00:00, run_id=scheduled__2024-07-04T03:09:00+00:00, run_start_date=2024-07-04 03:10:01.061818+00:00, run_end_date=2024-07-04 03:10:05.321418+00:00, run_duration=4.2596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:09:00+00:00, data_interval_end=2024-07-04 03:10:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:10:05.331601213Z [2024-07-04T03:10:05.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:10:00+00:00, run_after=2024-07-04T03:11:00+00:00 2024-07-04T03:10:05.395969557Z [2024-07-04T03:10:05.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:09:00+00:00 exited with status success for try_number 1 2024-07-04T03:10:05.396099519Z [2024-07-04T03:10:05.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:09:00+00:00 exited with status success for try_number 1 2024-07-04T03:10:05.413893867Z [2024-07-04T03:10:05.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:09:00+00:00, map_index=-1, run_start_date=2024-07-04 03:10:03.299073+00:00, run_end_date=2024-07-04 03:10:04.555415+00:00, run_duration=1.256342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:10:01.178786+00:00, queued_by_job_id=2, pid=8297 2024-07-04T03:10:05.414183016Z [2024-07-04T03:10:05.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:09:00+00:00, map_index=-1, run_start_date=2024-07-04 03:10:03.418329+00:00, run_end_date=2024-07-04 03:10:05.047488+00:00, run_duration=1.629159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:10:01.178786+00:00, queued_by_job_id=2, pid=8299 2024-07-04T03:10:06.502505261Z [2024-07-04T03:10:06.501+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:10:06.502545896Z 2024-07-04T03:10:06.502711522Z [2024-07-04T03:10:06.502+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:10:06.503404761Z [2024-07-04T03:10:06.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:10:06.503418010Z 2024-07-04T03:10:06.507165705Z [2024-07-04T03:10:06.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:10:06.507301768Z [2024-07-04T03:10:06.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:10:06.563817848Z [2024-07-04T03:10:06.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status queued for try_number 1 2024-07-04T03:10:06.564132346Z [2024-07-04T03:10:06.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status success for try_number 1 2024-07-04T03:10:06.571852313Z [2024-07-04T03:10:06.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2f8b62f-d8aa-4dc3-a941-13ee0a5a8053 2024-07-04T03:10:06.572360268Z [2024-07-04T03:10:06.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:05:00+00:00, map_index=-1, run_start_date=2024-07-04 03:10:05.720664+00:00, run_end_date=2024-07-04 03:10:06.112669+00:00, run_duration=0.392005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:10:04.045194+00:00, queued_by_job_id=2, pid=8337 2024-07-04T03:10:10.304876002Z [2024-07-04T03:10:10.304+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:10:10.304968706Z 2024-07-04T03:10:10.304997742Z [2024-07-04T03:10:10.304+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:10:10.305575685Z [2024-07-04T03:10:10.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:10:10.305610955Z 2024-07-04T03:10:10.308274249Z [2024-07-04T03:10:10.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:10:10.308411848Z [2024-07-04T03:10:10.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:10:10.391221347Z [2024-07-04T03:10:10.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status queued for try_number 1 2024-07-04T03:10:10.391506448Z [2024-07-04T03:10:10.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status success for try_number 1 2024-07-04T03:10:10.399361419Z [2024-07-04T03:10:10.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8717513a-60dd-41b9-9683-549291a3e6fa 2024-07-04T03:10:10.399721908Z [2024-07-04T03:10:10.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:05:00+00:00, map_index=0, run_start_date=2024-07-04 03:10:08.110549+00:00, run_end_date=2024-07-04 03:10:09.597540+00:00, run_duration=1.486991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:10:06.503786+00:00, queued_by_job_id=2, pid=8349 2024-07-04T03:10:12.984535290Z [2024-07-04T03:10:12.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:10:12.985006111Z [2024-07-04T03:10:12.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:05:00+00:00, run_id=scheduled__2024-07-04T03:05:00+00:00, run_start_date=2024-07-04 03:10:01.057225+00:00, run_end_date=2024-07-04 03:10:12.984650+00:00, run_duration=11.927425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:05:00+00:00, data_interval_end=2024-07-04 03:10:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:10:12.992455224Z [2024-07-04T03:10:12.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:10:00+00:00, run_after=2024-07-04T03:15:00+00:00 2024-07-04T03:10:13.034273247Z [2024-07-04T03:10:13.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:05:00+00:00 exited with status success for try_number 1 2024-07-04T03:10:13.041692308Z [2024-07-04T03:10:13.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:05:00+00:00, map_index=-1, run_start_date=2024-07-04 03:10:12.067311+00:00, run_end_date=2024-07-04 03:10:12.478259+00:00, run_duration=0.410948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:10:10.305943+00:00, queued_by_job_id=2, pid=8370 2024-07-04T03:11:00.882823397Z [2024-07-04T03:11:00.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:11:00+00:00, run_after=2024-07-04T03:12:00+00:00 2024-07-04T03:11:00.893876731Z [2024-07-04T03:11:00.893+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:11:00.964514997Z [2024-07-04T03:11:00.964+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:11:00.964537673Z 2024-07-04T03:11:00.964541309Z 2024-07-04T03:11:00.964544564Z [2024-07-04T03:11:00.964+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:11:00.964703447Z [2024-07-04T03:11:00.964+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:11:00.965300705Z [2024-07-04T03:11:00.965+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:11:00.965312700Z 2024-07-04T03:11:00.965316149Z 2024-07-04T03:11:00.968598110Z [2024-07-04T03:11:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:11:00.968729467Z [2024-07-04T03:11:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:11:00.969058497Z [2024-07-04T03:11:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:11:00.969193338Z [2024-07-04T03:11:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:11:01.392062114Z [2024-07-04T03:11:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status queued for try_number 1 2024-07-04T03:11:01.392102894Z [2024-07-04T03:11:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status queued for try_number 1 2024-07-04T03:11:01.400126479Z [2024-07-04T03:11:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7656b582-ecf1-48c5-9ee5-79564c70c4fc 2024-07-04T03:11:01.400219802Z [2024-07-04T03:11:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7061c5e-b4f7-499c-a604-51b1c5ce6a8a 2024-07-04T03:11:05.514019471Z [2024-07-04T03:11:05.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:11:05.514397096Z [2024-07-04T03:11:05.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:10:00+00:00, run_id=scheduled__2024-07-04T03:10:00+00:00, run_start_date=2024-07-04 03:11:00.908679+00:00, run_end_date=2024-07-04 03:11:05.513923+00:00, run_duration=4.605244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:10:00+00:00, data_interval_end=2024-07-04 03:11:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:11:05.530723188Z [2024-07-04T03:11:05.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:11:00+00:00, run_after=2024-07-04T03:12:00+00:00 2024-07-04T03:11:05.539412292Z [2024-07-04T03:11:05.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:11:05.539812584Z [2024-07-04T03:11:05.539+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:10:00+00:00, run_id=scheduled__2024-07-04T03:10:00+00:00, run_start_date=2024-07-04 03:11:00.911303+00:00, run_end_date=2024-07-04 03:11:05.539314+00:00, run_duration=4.628011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:10:00+00:00, data_interval_end=2024-07-04 03:11:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:11:05.550440045Z [2024-07-04T03:11:05.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:11:00+00:00, run_after=2024-07-04T03:12:00+00:00 2024-07-04T03:11:05.595884000Z [2024-07-04T03:11:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status success for try_number 1 2024-07-04T03:11:05.595990945Z [2024-07-04T03:11:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status success for try_number 1 2024-07-04T03:11:05.606117944Z [2024-07-04T03:11:05.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:10:00+00:00, map_index=-1, run_start_date=2024-07-04 03:11:02.884699+00:00, run_end_date=2024-07-04 03:11:04.507443+00:00, run_duration=1.622744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:11:00.965872+00:00, queued_by_job_id=2, pid=8408 2024-07-04T03:11:05.606241764Z [2024-07-04T03:11:05.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:10:00+00:00, map_index=-1, run_start_date=2024-07-04 03:11:02.874546+00:00, run_end_date=2024-07-04 03:11:04.812814+00:00, run_duration=1.938268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:11:00.965872+00:00, queued_by_job_id=2, pid=8407 2024-07-04T03:11:22.369398068Z [2024-07-04T03:11:22.368+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:12:00.642941532Z [2024-07-04T03:12:00.642+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:12:00.665457248Z [2024-07-04T03:12:00.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:12:00+00:00, run_after=2024-07-04T03:13:00+00:00 2024-07-04T03:12:00.680992908Z [2024-07-04T03:12:00.680+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:12:00.778508691Z [2024-07-04T03:12:00.778+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:12:00.778535220Z 2024-07-04T03:12:00.778539867Z 2024-07-04T03:12:00.778543333Z 2024-07-04T03:12:00.778713373Z [2024-07-04T03:12:00.778+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:12:00.778919294Z [2024-07-04T03:12:00.778+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:12:00.779116672Z [2024-07-04T03:12:00.778+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:12:00.781994187Z [2024-07-04T03:12:00.781+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:12:00.782015883Z 2024-07-04T03:12:00.782020390Z 2024-07-04T03:12:00.782023791Z 2024-07-04T03:12:00.791414645Z [2024-07-04T03:12:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:12:00.791719566Z [2024-07-04T03:12:00.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:12:00.792146720Z [2024-07-04T03:12:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:12:00.792331617Z [2024-07-04T03:12:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:12:00.792643254Z [2024-07-04T03:12:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:12:00.792814966Z [2024-07-04T03:12:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:12:01.154837358Z [2024-07-04T03:12:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status queued for try_number 1 2024-07-04T03:12:01.155111909Z [2024-07-04T03:12:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:11:00+00:00 exited with status queued for try_number 1 2024-07-04T03:12:01.155304913Z [2024-07-04T03:12:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:11:00+00:00 exited with status queued for try_number 1 2024-07-04T03:12:01.166106383Z [2024-07-04T03:12:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61e476cb-bbe0-483e-8c19-f3bbd119378b 2024-07-04T03:12:01.166797556Z [2024-07-04T03:12:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37cac3b0-7c5d-465f-a944-67053c11f615 2024-07-04T03:12:01.167070041Z [2024-07-04T03:12:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to b29ddf01-7955-4ed4-a8e4-8adce834d5b9 2024-07-04T03:12:02.334988684Z [2024-07-04T03:12:02.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:12:02.335564113Z [2024-07-04T03:12:02.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:10:00+00:00, run_id=scheduled__2024-07-04T03:10:00+00:00, run_start_date=2024-07-04 03:12:00.692197+00:00, run_end_date=2024-07-04 03:12:02.335178+00:00, run_duration=1.642981, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:10:00+00:00, data_interval_end=2024-07-04 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:12:02.344143296Z [2024-07-04T03:12:02.343+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:12:00+00:00, run_after=2024-07-04T03:14:00+00:00 2024-07-04T03:12:02.415405879Z [2024-07-04T03:12:02.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status success for try_number 1 2024-07-04T03:12:02.424144011Z [2024-07-04T03:12:02.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:10:00+00:00, map_index=-1, run_start_date=2024-07-04 03:12:01.693742+00:00, run_end_date=2024-07-04 03:12:02.139827+00:00, run_duration=0.446085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:12:00.787590+00:00, queued_by_job_id=2, pid=8443 2024-07-04T03:12:04.853403610Z [2024-07-04T03:12:04.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:12:04.853717999Z [2024-07-04T03:12:04.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:11:00+00:00, run_id=scheduled__2024-07-04T03:11:00+00:00, run_start_date=2024-07-04 03:12:00.693893+00:00, run_end_date=2024-07-04 03:12:04.853362+00:00, run_duration=4.159469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:11:00+00:00, data_interval_end=2024-07-04 03:12:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:12:04.862113024Z [2024-07-04T03:12:04.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:12:00+00:00, run_after=2024-07-04T03:13:00+00:00 2024-07-04T03:12:04.903445177Z [2024-07-04T03:12:04.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:11:00+00:00 exited with status success for try_number 1 2024-07-04T03:12:04.909492390Z [2024-07-04T03:12:04.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:11:00+00:00, map_index=-1, run_start_date=2024-07-04 03:12:02.798151+00:00, run_end_date=2024-07-04 03:12:04.328180+00:00, run_duration=1.530029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:12:00.787590+00:00, queued_by_job_id=2, pid=8473 2024-07-04T03:12:05.966236549Z [2024-07-04T03:12:05.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:12:05.966456648Z [2024-07-04T03:12:05.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:11:00+00:00, run_id=scheduled__2024-07-04T03:11:00+00:00, run_start_date=2024-07-04 03:12:00.695099+00:00, run_end_date=2024-07-04 03:12:05.965578+00:00, run_duration=5.270479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:11:00+00:00, data_interval_end=2024-07-04 03:12:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:12:05.979193268Z [2024-07-04T03:12:05.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:12:00+00:00, run_after=2024-07-04T03:13:00+00:00 2024-07-04T03:12:06.033076297Z [2024-07-04T03:12:06.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:11:00+00:00 exited with status success for try_number 1 2024-07-04T03:12:06.043468976Z [2024-07-04T03:12:06.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:11:00+00:00, map_index=-1, run_start_date=2024-07-04 03:12:02.848391+00:00, run_end_date=2024-07-04 03:12:05.059607+00:00, run_duration=2.211216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:12:00.787590+00:00, queued_by_job_id=2, pid=8474 2024-07-04T03:13:00.476997065Z [2024-07-04T03:13:00.475+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:13:00.494100807Z [2024-07-04T03:13:00.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:13:00+00:00, run_after=2024-07-04T03:14:00+00:00 2024-07-04T03:13:00.547534937Z [2024-07-04T03:13:00.547+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:13:00.547569491Z 2024-07-04T03:13:00.547573799Z 2024-07-04T03:13:00.547583599Z [2024-07-04T03:13:00.547+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:13:00.547613765Z [2024-07-04T03:13:00.547+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:13:00.548197395Z [2024-07-04T03:13:00.548+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:13:00.548210458Z 2024-07-04T03:13:00.548214143Z 2024-07-04T03:13:00.551080214Z [2024-07-04T03:13:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:13:00.551188394Z [2024-07-04T03:13:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:13:00.551380948Z [2024-07-04T03:13:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:13:00.551453203Z [2024-07-04T03:13:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:13:00.728466369Z [2024-07-04T03:13:00.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:12:00+00:00 exited with status queued for try_number 1 2024-07-04T03:13:00.730854212Z [2024-07-04T03:13:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:12:00+00:00 exited with status queued for try_number 1 2024-07-04T03:13:00.744662469Z [2024-07-04T03:13:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbc0a6d9-0830-40d1-8249-004c7d9ed9e8 2024-07-04T03:13:00.744846167Z [2024-07-04T03:13:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 987ba472-3544-49c1-b577-647e21981505 2024-07-04T03:13:04.132458201Z [2024-07-04T03:13:04.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:13:04.133002924Z [2024-07-04T03:13:04.132+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:12:00+00:00, run_id=scheduled__2024-07-04T03:12:00+00:00, run_start_date=2024-07-04 03:13:00.504601+00:00, run_end_date=2024-07-04 03:13:04.132401+00:00, run_duration=3.6278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:12:00+00:00, data_interval_end=2024-07-04 03:13:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:13:04.147923555Z [2024-07-04T03:13:04.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:13:00+00:00, run_after=2024-07-04T03:14:00+00:00 2024-07-04T03:13:04.215462725Z [2024-07-04T03:13:04.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:12:00+00:00 exited with status success for try_number 1 2024-07-04T03:13:04.229742586Z [2024-07-04T03:13:04.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:12:00+00:00, map_index=-1, run_start_date=2024-07-04 03:13:02.393197+00:00, run_end_date=2024-07-04 03:13:03.802414+00:00, run_duration=1.409217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:13:00.548724+00:00, queued_by_job_id=2, pid=8528 2024-07-04T03:13:04.489458254Z [2024-07-04T03:13:04.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:13:04.490079042Z [2024-07-04T03:13:04.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:12:00+00:00, run_id=scheduled__2024-07-04T03:12:00+00:00, run_start_date=2024-07-04 03:13:00.506283+00:00, run_end_date=2024-07-04 03:13:04.489524+00:00, run_duration=3.983241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:12:00+00:00, data_interval_end=2024-07-04 03:13:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:13:04.506279498Z [2024-07-04T03:13:04.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:13:00+00:00, run_after=2024-07-04T03:14:00+00:00 2024-07-04T03:13:05.661659052Z [2024-07-04T03:13:05.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:12:00+00:00 exited with status success for try_number 1 2024-07-04T03:13:05.671597949Z [2024-07-04T03:13:05.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:12:00+00:00, map_index=-1, run_start_date=2024-07-04 03:13:02.447496+00:00, run_end_date=2024-07-04 03:13:04.454420+00:00, run_duration=2.006924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:13:00.548724+00:00, queued_by_job_id=2, pid=8529 2024-07-04T03:14:00.427961203Z [2024-07-04T03:14:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:14:00+00:00, run_after=2024-07-04T03:15:00+00:00 2024-07-04T03:14:00.440415954Z [2024-07-04T03:14:00.439+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:14:00.450532500Z [2024-07-04T03:14:00.450+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:14:00.547005075Z [2024-07-04T03:14:00.546+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:14:00.547042225Z 2024-07-04T03:14:00.547049090Z 2024-07-04T03:14:00.547054791Z 2024-07-04T03:14:00.547362726Z [2024-07-04T03:14:00.547+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:14:00.547728332Z [2024-07-04T03:14:00.547+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:14:00.547964967Z [2024-07-04T03:14:00.547+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:14:00.549529926Z [2024-07-04T03:14:00.549+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:14:00.549545365Z 2024-07-04T03:14:00.549552140Z 2024-07-04T03:14:00.549576604Z 2024-07-04T03:14:00.561256563Z [2024-07-04T03:14:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:14:00.561726032Z [2024-07-04T03:14:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:14:00.562143544Z [2024-07-04T03:14:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:14:00.562413173Z [2024-07-04T03:14:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:14:00.562917571Z [2024-07-04T03:14:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:14:00.563160856Z [2024-07-04T03:14:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:14:00.917909963Z [2024-07-04T03:14:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:12:00+00:00 exited with status queued for try_number 1 2024-07-04T03:14:00.918068656Z [2024-07-04T03:14:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:13:00+00:00 exited with status queued for try_number 1 2024-07-04T03:14:00.918180046Z [2024-07-04T03:14:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:13:00+00:00 exited with status queued for try_number 1 2024-07-04T03:14:00.939138808Z [2024-07-04T03:14:00.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfb1ce38-b133-4884-8c3e-0ca160b4c51b 2024-07-04T03:14:00.939173667Z [2024-07-04T03:14:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 926fac7a-1931-475c-96d1-c1b3e48910eb 2024-07-04T03:14:00.939277850Z [2024-07-04T03:14:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to ded154df-7445-406c-83a6-6cf350e1d83e 2024-07-04T03:14:02.165391973Z [2024-07-04T03:14:02.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:14:02.165845709Z [2024-07-04T03:14:02.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:12:00+00:00, run_id=scheduled__2024-07-04T03:12:00+00:00, run_start_date=2024-07-04 03:14:00.465818+00:00, run_end_date=2024-07-04 03:14:02.165285+00:00, run_duration=1.699467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:12:00+00:00, data_interval_end=2024-07-04 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:14:02.175203881Z [2024-07-04T03:14:02.174+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:14:00+00:00, run_after=2024-07-04T03:16:00+00:00 2024-07-04T03:14:02.248227675Z [2024-07-04T03:14:02.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:12:00+00:00 exited with status success for try_number 1 2024-07-04T03:14:02.256668426Z [2024-07-04T03:14:02.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:12:00+00:00, map_index=-1, run_start_date=2024-07-04 03:14:01.474411+00:00, run_end_date=2024-07-04 03:14:01.952593+00:00, run_duration=0.478182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:14:00.550615+00:00, queued_by_job_id=2, pid=8565 2024-07-04T03:14:04.627443603Z [2024-07-04T03:14:04.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:14:04.627567890Z [2024-07-04T03:14:04.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:13:00+00:00, run_id=scheduled__2024-07-04T03:13:00+00:00, run_start_date=2024-07-04 03:14:00.469272+00:00, run_end_date=2024-07-04 03:14:04.627321+00:00, run_duration=4.158049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:13:00+00:00, data_interval_end=2024-07-04 03:14:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:14:04.638686924Z [2024-07-04T03:14:04.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:14:00+00:00, run_after=2024-07-04T03:15:00+00:00 2024-07-04T03:14:05.731429141Z [2024-07-04T03:14:05.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:14:05.731877630Z [2024-07-04T03:14:05.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:13:00+00:00, run_id=scheduled__2024-07-04T03:13:00+00:00, run_start_date=2024-07-04 03:14:00.468005+00:00, run_end_date=2024-07-04 03:14:05.731336+00:00, run_duration=5.263331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:13:00+00:00, data_interval_end=2024-07-04 03:14:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:14:05.743757669Z [2024-07-04T03:14:05.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:14:00+00:00, run_after=2024-07-04T03:15:00+00:00 2024-07-04T03:14:05.775332605Z [2024-07-04T03:14:05.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:13:00+00:00 exited with status success for try_number 1 2024-07-04T03:14:05.775415563Z [2024-07-04T03:14:05.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:13:00+00:00 exited with status success for try_number 1 2024-07-04T03:14:05.781278218Z [2024-07-04T03:14:05.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:13:00+00:00, map_index=-1, run_start_date=2024-07-04 03:14:02.781160+00:00, run_end_date=2024-07-04 03:14:04.544612+00:00, run_duration=1.763452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:14:00.550615+00:00, queued_by_job_id=2, pid=8596 2024-07-04T03:14:05.781512115Z [2024-07-04T03:14:05.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:13:00+00:00, map_index=-1, run_start_date=2024-07-04 03:14:02.704193+00:00, run_end_date=2024-07-04 03:14:04.577041+00:00, run_duration=1.872848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:14:00.550615+00:00, queued_by_job_id=2, pid=8595 2024-07-04T03:15:00.971940598Z [2024-07-04T03:15:00.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:15:00+00:00, run_after=2024-07-04T03:16:00+00:00 2024-07-04T03:15:00.984455867Z [2024-07-04T03:15:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:15:00+00:00, run_after=2024-07-04T03:20:00+00:00 2024-07-04T03:15:00.991582935Z [2024-07-04T03:15:00.991+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:15:01.057711916Z [2024-07-04T03:15:01.057+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:15:01.057740896Z 2024-07-04T03:15:01.057770603Z 2024-07-04T03:15:01.057775235Z 2024-07-04T03:15:01.057792394Z [2024-07-04T03:15:01.057+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:15:01.057963499Z [2024-07-04T03:15:01.057+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:15:01.058072706Z [2024-07-04T03:15:01.057+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:15:01.058741631Z [2024-07-04T03:15:01.058+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:15:01.058753824Z 2024-07-04T03:15:01.058783700Z 2024-07-04T03:15:01.058788211Z 2024-07-04T03:15:01.062522775Z [2024-07-04T03:15:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:15:01.062698073Z [2024-07-04T03:15:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:15:01.062958518Z [2024-07-04T03:15:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:15:01.063072105Z [2024-07-04T03:15:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:15:01.063399894Z [2024-07-04T03:15:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:15:01.063526695Z [2024-07-04T03:15:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:15:01.497787562Z [2024-07-04T03:15:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status queued for try_number 1 2024-07-04T03:15:01.497879088Z [2024-07-04T03:15:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:14:00+00:00 exited with status queued for try_number 1 2024-07-04T03:15:01.497997009Z [2024-07-04T03:15:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:14:00+00:00 exited with status queued for try_number 1 2024-07-04T03:15:01.526783056Z [2024-07-04T03:15:01.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bc35a45-158d-499d-b205-607efb8be3af 2024-07-04T03:15:01.527156220Z [2024-07-04T03:15:01.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d17674c-d1dc-4b00-9ff7-512042ecc799 2024-07-04T03:15:01.527410276Z [2024-07-04T03:15:01.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dd5c179-48ef-4548-a0ab-add47ac51db3 2024-07-04T03:15:04.260981611Z [2024-07-04T03:15:04.260+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:15:04.261049976Z 2024-07-04T03:15:04.261154993Z [2024-07-04T03:15:04.260+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:15:04.262007506Z [2024-07-04T03:15:04.261+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:15:04.262024775Z 2024-07-04T03:15:04.265233655Z [2024-07-04T03:15:04.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:15:04.265487204Z [2024-07-04T03:15:04.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:15:04.316702828Z [2024-07-04T03:15:04.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status queued for try_number 1 2024-07-04T03:15:04.316896601Z [2024-07-04T03:15:04.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status success for try_number 1 2024-07-04T03:15:04.322517673Z [2024-07-04T03:15:04.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6e6649a-4e7d-4684-bf57-d4050c95193b 2024-07-04T03:15:04.322849185Z [2024-07-04T03:15:04.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:10:00+00:00, map_index=-1, run_start_date=2024-07-04 03:15:03.190495+00:00, run_end_date=2024-07-04 03:15:03.647695+00:00, run_duration=0.4572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:15:01.059529+00:00, queued_by_job_id=2, pid=8662 2024-07-04T03:15:05.085196020Z [2024-07-04T03:15:05.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:15:05.085724869Z [2024-07-04T03:15:05.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:14:00+00:00, run_id=scheduled__2024-07-04T03:14:00+00:00, run_start_date=2024-07-04 03:15:01.004414+00:00, run_end_date=2024-07-04 03:15:05.085090+00:00, run_duration=4.080676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:14:00+00:00, data_interval_end=2024-07-04 03:15:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:15:05.104682769Z [2024-07-04T03:15:05.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:15:00+00:00, run_after=2024-07-04T03:16:00+00:00 2024-07-04T03:15:05.185409716Z [2024-07-04T03:15:05.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:14:00+00:00 exited with status success for try_number 1 2024-07-04T03:15:05.200075087Z [2024-07-04T03:15:05.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:14:00+00:00, map_index=-1, run_start_date=2024-07-04 03:15:03.182361+00:00, run_end_date=2024-07-04 03:15:04.623293+00:00, run_duration=1.440932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:15:01.059529+00:00, queued_by_job_id=2, pid=8661 2024-07-04T03:15:06.265885113Z [2024-07-04T03:15:06.265+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:15:06.266091660Z [2024-07-04T03:15:06.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:14:00+00:00, run_id=scheduled__2024-07-04T03:14:00+00:00, run_start_date=2024-07-04 03:15:01.005498+00:00, run_end_date=2024-07-04 03:15:06.265747+00:00, run_duration=5.260249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:14:00+00:00, data_interval_end=2024-07-04 03:15:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:15:06.274381159Z [2024-07-04T03:15:06.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:15:00+00:00, run_after=2024-07-04T03:16:00+00:00 2024-07-04T03:15:06.314975154Z [2024-07-04T03:15:06.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:14:00+00:00 exited with status success for try_number 1 2024-07-04T03:15:06.320703668Z [2024-07-04T03:15:06.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:14:00+00:00, map_index=-1, run_start_date=2024-07-04 03:15:03.205555+00:00, run_end_date=2024-07-04 03:15:05.112470+00:00, run_duration=1.906915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:15:01.059529+00:00, queued_by_job_id=2, pid=8663 2024-07-04T03:15:07.093341581Z [2024-07-04T03:15:07.092+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:15:07.093374351Z 2024-07-04T03:15:07.093592634Z [2024-07-04T03:15:07.093+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:15:07.096043363Z [2024-07-04T03:15:07.095+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:15:07.096080162Z 2024-07-04T03:15:07.101107259Z [2024-07-04T03:15:07.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:15:07.101501264Z [2024-07-04T03:15:07.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:15:07.158213676Z [2024-07-04T03:15:07.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status queued for try_number 1 2024-07-04T03:15:07.158263273Z [2024-07-04T03:15:07.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status success for try_number 1 2024-07-04T03:15:07.167945313Z [2024-07-04T03:15:07.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 812cb2e8-940d-4619-a289-c55572364f65 2024-07-04T03:15:07.168032144Z [2024-07-04T03:15:07.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:10:00+00:00, map_index=-1, run_start_date=2024-07-04 03:15:05.966017+00:00, run_end_date=2024-07-04 03:15:06.379126+00:00, run_duration=0.413109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:15:04.262478+00:00, queued_by_job_id=2, pid=8702 2024-07-04T03:15:11.505095822Z [2024-07-04T03:15:11.504+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:15:11.505143706Z 2024-07-04T03:15:11.505190693Z [2024-07-04T03:15:11.504+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:15:11.505837242Z [2024-07-04T03:15:11.505+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:15:11.505865598Z 2024-07-04T03:15:11.508833949Z [2024-07-04T03:15:11.508+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:15:11.508912485Z [2024-07-04T03:15:11.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:15:11.577833523Z [2024-07-04T03:15:11.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status queued for try_number 1 2024-07-04T03:15:11.578057915Z [2024-07-04T03:15:11.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status success for try_number 1 2024-07-04T03:15:11.590078546Z [2024-07-04T03:15:11.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to f32ced7a-7583-439b-a824-08d3a1b3c365 2024-07-04T03:15:11.590400556Z [2024-07-04T03:15:11.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:10:00+00:00, map_index=0, run_start_date=2024-07-04 03:15:08.827759+00:00, run_end_date=2024-07-04 03:15:10.349031+00:00, run_duration=1.521272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:15:07.096909+00:00, queued_by_job_id=2, pid=8714 2024-07-04T03:15:14.501705170Z [2024-07-04T03:15:14.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:15:14.501765055Z [2024-07-04T03:15:14.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:10:00+00:00, run_id=scheduled__2024-07-04T03:10:00+00:00, run_start_date=2024-07-04 03:15:01.002998+00:00, run_end_date=2024-07-04 03:15:14.501405+00:00, run_duration=13.498407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:10:00+00:00, data_interval_end=2024-07-04 03:15:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:15:14.523039959Z [2024-07-04T03:15:14.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:15:00+00:00, run_after=2024-07-04T03:20:00+00:00 2024-07-04T03:15:14.570882404Z [2024-07-04T03:15:14.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:10:00+00:00 exited with status success for try_number 1 2024-07-04T03:15:14.581592681Z [2024-07-04T03:15:14.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:10:00+00:00, map_index=-1, run_start_date=2024-07-04 03:15:13.260420+00:00, run_end_date=2024-07-04 03:15:13.675572+00:00, run_duration=0.415152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:15:11.506120+00:00, queued_by_job_id=2, pid=8735 2024-07-04T03:16:01.017807109Z [2024-07-04T03:16:01.017+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:16:01.028555490Z [2024-07-04T03:16:01.027+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:16:01.052156989Z [2024-07-04T03:16:01.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:16:00+00:00, run_after=2024-07-04T03:17:00+00:00 2024-07-04T03:16:01.142178212Z [2024-07-04T03:16:01.141+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:16:01.142244315Z 2024-07-04T03:16:01.142301550Z 2024-07-04T03:16:01.142318386Z 2024-07-04T03:16:01.142659917Z [2024-07-04T03:16:01.142+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:16:01.143029287Z [2024-07-04T03:16:01.142+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:16:01.143388341Z [2024-07-04T03:16:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:16:01.144524933Z [2024-07-04T03:16:01.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:16:01.144549964Z 2024-07-04T03:16:01.144559403Z 2024-07-04T03:16:01.144568189Z 2024-07-04T03:16:01.150399146Z [2024-07-04T03:16:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:16:01.150848783Z [2024-07-04T03:16:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:16:01.151376938Z [2024-07-04T03:16:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:16:01.151649746Z [2024-07-04T03:16:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:16:01.152127830Z [2024-07-04T03:16:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:16:01.152413238Z [2024-07-04T03:16:01.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:16:01.553585593Z [2024-07-04T03:16:01.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:14:00+00:00 exited with status queued for try_number 1 2024-07-04T03:16:01.553613435Z [2024-07-04T03:16:01.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status queued for try_number 1 2024-07-04T03:16:01.553632397Z [2024-07-04T03:16:01.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status queued for try_number 1 2024-07-04T03:16:01.573740472Z [2024-07-04T03:16:01.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43e70f6d-934f-4e66-8966-7af98a15772a 2024-07-04T03:16:01.574121840Z [2024-07-04T03:16:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f45b005-3264-4568-8eeb-e396a6aa8c2f 2024-07-04T03:16:01.575406653Z [2024-07-04T03:16:01.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to d146f276-42ec-4893-8bcb-6ac695021f65 2024-07-04T03:16:02.777149627Z [2024-07-04T03:16:02.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:16:02.777610603Z [2024-07-04T03:16:02.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:14:00+00:00, run_id=scheduled__2024-07-04T03:14:00+00:00, run_start_date=2024-07-04 03:16:01.067612+00:00, run_end_date=2024-07-04 03:16:02.777047+00:00, run_duration=1.709435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:14:00+00:00, data_interval_end=2024-07-04 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:16:02.788502315Z [2024-07-04T03:16:02.786+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:16:00+00:00, run_after=2024-07-04T03:18:00+00:00 2024-07-04T03:16:02.844473480Z [2024-07-04T03:16:02.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:14:00+00:00 exited with status success for try_number 1 2024-07-04T03:16:02.851709001Z [2024-07-04T03:16:02.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:14:00+00:00, map_index=-1, run_start_date=2024-07-04 03:16:01.861791+00:00, run_end_date=2024-07-04 03:16:02.330728+00:00, run_duration=0.468937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:16:01.145918+00:00, queued_by_job_id=2, pid=8752 2024-07-04T03:16:05.138961242Z [2024-07-04T03:16:05.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:16:05.139866904Z [2024-07-04T03:16:05.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:15:00+00:00, run_id=scheduled__2024-07-04T03:15:00+00:00, run_start_date=2024-07-04 03:16:01.069277+00:00, run_end_date=2024-07-04 03:16:05.138774+00:00, run_duration=4.069497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:15:00+00:00, data_interval_end=2024-07-04 03:16:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:16:05.159354643Z [2024-07-04T03:16:05.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:16:00+00:00, run_after=2024-07-04T03:17:00+00:00 2024-07-04T03:16:05.238858038Z [2024-07-04T03:16:05.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status success for try_number 1 2024-07-04T03:16:05.249839956Z [2024-07-04T03:16:05.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:15:00+00:00, map_index=-1, run_start_date=2024-07-04 03:16:03.419692+00:00, run_end_date=2024-07-04 03:16:04.962617+00:00, run_duration=1.542925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:16:01.145918+00:00, queued_by_job_id=2, pid=8783 2024-07-04T03:16:05.608855970Z [2024-07-04T03:16:05.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:16:05.609269439Z [2024-07-04T03:16:05.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:15:00+00:00, run_id=scheduled__2024-07-04T03:15:00+00:00, run_start_date=2024-07-04 03:16:01.071097+00:00, run_end_date=2024-07-04 03:16:05.608823+00:00, run_duration=4.537726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:15:00+00:00, data_interval_end=2024-07-04 03:16:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:16:05.619730379Z [2024-07-04T03:16:05.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:16:00+00:00, run_after=2024-07-04T03:17:00+00:00 2024-07-04T03:16:05.667300913Z [2024-07-04T03:16:05.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status success for try_number 1 2024-07-04T03:16:05.677777341Z [2024-07-04T03:16:05.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:15:00+00:00, map_index=-1, run_start_date=2024-07-04 03:16:03.378124+00:00, run_end_date=2024-07-04 03:16:05.429856+00:00, run_duration=2.051732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:16:01.145918+00:00, queued_by_job_id=2, pid=8782 2024-07-04T03:16:22.445369111Z [2024-07-04T03:16:22.444+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:17:00.894563631Z [2024-07-04T03:17:00.894+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:17:00.908166168Z [2024-07-04T03:17:00.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:17:00+00:00, run_after=2024-07-04T03:18:00+00:00 2024-07-04T03:17:00.996761531Z [2024-07-04T03:17:00.996+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:17:00.996793721Z 2024-07-04T03:17:00.996797714Z 2024-07-04T03:17:00.997013338Z [2024-07-04T03:17:00.996+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:17:00.997213535Z [2024-07-04T03:17:00.997+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:17:00.998027270Z [2024-07-04T03:17:00.997+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:17:00.998038935Z 2024-07-04T03:17:00.998042386Z 2024-07-04T03:17:01.002435012Z [2024-07-04T03:17:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:17:01.002641442Z [2024-07-04T03:17:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:17:01.003048581Z [2024-07-04T03:17:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:17:01.003321894Z [2024-07-04T03:17:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:17:01.193605680Z [2024-07-04T03:17:01.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:16:00+00:00 exited with status queued for try_number 1 2024-07-04T03:17:01.193638465Z [2024-07-04T03:17:01.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:16:00+00:00 exited with status queued for try_number 1 2024-07-04T03:17:01.204059446Z [2024-07-04T03:17:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to d791630f-8143-4765-9b7a-167329413ad2 2024-07-04T03:17:01.204089494Z [2024-07-04T03:17:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to e934f59c-0839-4e7b-9a95-2605b42e356d 2024-07-04T03:17:04.997131479Z [2024-07-04T03:17:04.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:17:04.997166459Z [2024-07-04T03:17:04.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:16:00+00:00, run_id=scheduled__2024-07-04T03:16:00+00:00, run_start_date=2024-07-04 03:17:00.923617+00:00, run_end_date=2024-07-04 03:17:04.995733+00:00, run_duration=4.072116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:16:00+00:00, data_interval_end=2024-07-04 03:17:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:17:05.023271549Z [2024-07-04T03:17:05.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:17:00+00:00, run_after=2024-07-04T03:18:00+00:00 2024-07-04T03:17:05.074044615Z [2024-07-04T03:17:05.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:16:00+00:00 exited with status success for try_number 1 2024-07-04T03:17:05.080462956Z [2024-07-04T03:17:05.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:16:00+00:00, map_index=-1, run_start_date=2024-07-04 03:17:02.945383+00:00, run_end_date=2024-07-04 03:17:04.477899+00:00, run_duration=1.532516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:17:00.998719+00:00, queued_by_job_id=2, pid=8838 2024-07-04T03:17:06.084201013Z [2024-07-04T03:17:06.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:17:06.084278721Z [2024-07-04T03:17:06.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:16:00+00:00, run_id=scheduled__2024-07-04T03:16:00+00:00, run_start_date=2024-07-04 03:17:00.925112+00:00, run_end_date=2024-07-04 03:17:06.084057+00:00, run_duration=5.158945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:16:00+00:00, data_interval_end=2024-07-04 03:17:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:17:06.093396416Z [2024-07-04T03:17:06.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:17:00+00:00, run_after=2024-07-04T03:18:00+00:00 2024-07-04T03:17:06.128255106Z [2024-07-04T03:17:06.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:16:00+00:00 exited with status success for try_number 1 2024-07-04T03:17:06.133141520Z [2024-07-04T03:17:06.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:16:00+00:00, map_index=-1, run_start_date=2024-07-04 03:17:02.893497+00:00, run_end_date=2024-07-04 03:17:05.383514+00:00, run_duration=2.490017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:17:00.998719+00:00, queued_by_job_id=2, pid=8837 2024-07-04T03:18:00.836849485Z [2024-07-04T03:18:00.836+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:18:00.845656468Z [2024-07-04T03:18:00.844+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:18:00.869823913Z [2024-07-04T03:18:00.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:18:00+00:00, run_after=2024-07-04T03:19:00+00:00 2024-07-04T03:18:00.950408446Z [2024-07-04T03:18:00.950+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:18:00.950441868Z 2024-07-04T03:18:00.950450230Z 2024-07-04T03:18:00.950456286Z 2024-07-04T03:18:00.950462766Z [2024-07-04T03:18:00.950+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:18:00.950524448Z [2024-07-04T03:18:00.950+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:18:00.950628042Z [2024-07-04T03:18:00.950+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:18:00.951328867Z [2024-07-04T03:18:00.951+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:18:00.951353830Z 2024-07-04T03:18:00.951360892Z 2024-07-04T03:18:00.951366230Z 2024-07-04T03:18:00.955524620Z [2024-07-04T03:18:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:18:00.955651105Z [2024-07-04T03:18:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:18:00.955839521Z [2024-07-04T03:18:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:18:00.955923011Z [2024-07-04T03:18:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:18:00.956085265Z [2024-07-04T03:18:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:18:00.956149922Z [2024-07-04T03:18:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:18:01.254083146Z [2024-07-04T03:18:01.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:16:00+00:00 exited with status queued for try_number 1 2024-07-04T03:18:01.254216789Z [2024-07-04T03:18:01.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:17:00+00:00 exited with status queued for try_number 1 2024-07-04T03:18:01.254226382Z [2024-07-04T03:18:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:17:00+00:00 exited with status queued for try_number 1 2024-07-04T03:18:01.277890480Z [2024-07-04T03:18:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3de8f48-f7de-4e4f-bcdc-a00e190a87e1 2024-07-04T03:18:01.278105912Z [2024-07-04T03:18:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6267c0a2-6e87-427f-a780-74346ddd0399 2024-07-04T03:18:01.278402380Z [2024-07-04T03:18:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67dee14d-1250-41bd-bf19-e90a81751805 2024-07-04T03:18:02.500038412Z [2024-07-04T03:18:02.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:18:02.500656365Z [2024-07-04T03:18:02.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:16:00+00:00, run_id=scheduled__2024-07-04T03:16:00+00:00, run_start_date=2024-07-04 03:18:00.883687+00:00, run_end_date=2024-07-04 03:18:02.500124+00:00, run_duration=1.616437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:16:00+00:00, data_interval_end=2024-07-04 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:18:02.511998939Z [2024-07-04T03:18:02.511+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:18:00+00:00, run_after=2024-07-04T03:20:00+00:00 2024-07-04T03:18:02.562902968Z [2024-07-04T03:18:02.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:16:00+00:00 exited with status success for try_number 1 2024-07-04T03:18:02.574098374Z [2024-07-04T03:18:02.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:16:00+00:00, map_index=-1, run_start_date=2024-07-04 03:18:01.743655+00:00, run_end_date=2024-07-04 03:18:02.159422+00:00, run_duration=0.415767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:18:00.952062+00:00, queued_by_job_id=2, pid=8873 2024-07-04T03:18:04.852181517Z [2024-07-04T03:18:04.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:18:04.852735666Z [2024-07-04T03:18:04.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:17:00+00:00, run_id=scheduled__2024-07-04T03:17:00+00:00, run_start_date=2024-07-04 03:18:00.886014+00:00, run_end_date=2024-07-04 03:18:04.852124+00:00, run_duration=3.96611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:17:00+00:00, data_interval_end=2024-07-04 03:18:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:18:04.865056983Z [2024-07-04T03:18:04.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:18:00+00:00, run_after=2024-07-04T03:19:00+00:00 2024-07-04T03:18:05.976851863Z [2024-07-04T03:18:05.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:18:05.978625365Z [2024-07-04T03:18:05.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:17:00+00:00, run_id=scheduled__2024-07-04T03:17:00+00:00, run_start_date=2024-07-04 03:18:00.887336+00:00, run_end_date=2024-07-04 03:18:05.976694+00:00, run_duration=5.089358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:17:00+00:00, data_interval_end=2024-07-04 03:18:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:18:05.990222868Z [2024-07-04T03:18:05.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:18:00+00:00, run_after=2024-07-04T03:19:00+00:00 2024-07-04T03:18:06.040604381Z [2024-07-04T03:18:06.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:17:00+00:00 exited with status success for try_number 1 2024-07-04T03:18:06.040770443Z [2024-07-04T03:18:06.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:17:00+00:00 exited with status success for try_number 1 2024-07-04T03:18:06.050625926Z [2024-07-04T03:18:06.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:17:00+00:00, map_index=-1, run_start_date=2024-07-04 03:18:03.033819+00:00, run_end_date=2024-07-04 03:18:04.800327+00:00, run_duration=1.766508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:18:00.952062+00:00, queued_by_job_id=2, pid=8904 2024-07-04T03:18:06.050833882Z [2024-07-04T03:18:06.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:17:00+00:00, map_index=-1, run_start_date=2024-07-04 03:18:02.918313+00:00, run_end_date=2024-07-04 03:18:04.810455+00:00, run_duration=1.892142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:18:00.952062+00:00, queued_by_job_id=2, pid=8903 2024-07-04T03:19:00.180036324Z [2024-07-04T03:19:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:19:00+00:00, run_after=2024-07-04T03:20:00+00:00 2024-07-04T03:19:00.188948847Z [2024-07-04T03:19:00.188+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:19:00.244967929Z [2024-07-04T03:19:00.244+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:19:00.244997025Z 2024-07-04T03:19:00.245001095Z 2024-07-04T03:19:00.245010901Z [2024-07-04T03:19:00.244+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:19:00.245209792Z [2024-07-04T03:19:00.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:19:00.245909985Z [2024-07-04T03:19:00.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:19:00.245921541Z 2024-07-04T03:19:00.245928093Z 2024-07-04T03:19:00.248992364Z [2024-07-04T03:19:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:19:00.249209068Z [2024-07-04T03:19:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:19:00.249541387Z [2024-07-04T03:19:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:19:00.249681761Z [2024-07-04T03:19:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:19:00.522959656Z [2024-07-04T03:19:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:18:00+00:00 exited with status queued for try_number 1 2024-07-04T03:19:00.525177364Z [2024-07-04T03:19:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:18:00+00:00 exited with status queued for try_number 1 2024-07-04T03:19:00.533906058Z [2024-07-04T03:19:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77cb8daf-7044-4038-aac8-c6ce0a2f2ba6 2024-07-04T03:19:00.534148888Z [2024-07-04T03:19:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 817128c1-1e5c-46b7-90de-d3b0d5d0b9d4 2024-07-04T03:19:04.281360977Z [2024-07-04T03:19:04.280+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:19:04.281672053Z [2024-07-04T03:19:04.281+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:18:00+00:00, run_id=scheduled__2024-07-04T03:18:00+00:00, run_start_date=2024-07-04 03:19:00.199128+00:00, run_end_date=2024-07-04 03:19:04.281110+00:00, run_duration=4.081982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:18:00+00:00, data_interval_end=2024-07-04 03:19:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:19:04.295147400Z [2024-07-04T03:19:04.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:19:00+00:00, run_after=2024-07-04T03:20:00+00:00 2024-07-04T03:19:04.304698489Z [2024-07-04T03:19:04.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:19:04.305020327Z [2024-07-04T03:19:04.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:18:00+00:00, run_id=scheduled__2024-07-04T03:18:00+00:00, run_start_date=2024-07-04 03:19:00.200417+00:00, run_end_date=2024-07-04 03:19:04.304579+00:00, run_duration=4.104162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:18:00+00:00, data_interval_end=2024-07-04 03:19:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:19:04.317402208Z [2024-07-04T03:19:04.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:19:00+00:00, run_after=2024-07-04T03:20:00+00:00 2024-07-04T03:19:04.367204918Z [2024-07-04T03:19:04.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:18:00+00:00 exited with status success for try_number 1 2024-07-04T03:19:04.367795419Z [2024-07-04T03:19:04.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:18:00+00:00 exited with status success for try_number 1 2024-07-04T03:19:04.383660011Z [2024-07-04T03:19:04.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:18:00+00:00, map_index=-1, run_start_date=2024-07-04 03:19:02.191128+00:00, run_end_date=2024-07-04 03:19:03.501382+00:00, run_duration=1.310254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:19:00.246662+00:00, queued_by_job_id=2, pid=8950 2024-07-04T03:19:04.384235660Z [2024-07-04T03:19:04.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:18:00+00:00, map_index=-1, run_start_date=2024-07-04 03:19:02.434416+00:00, run_end_date=2024-07-04 03:19:04.065634+00:00, run_duration=1.631218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:19:00.246662+00:00, queued_by_job_id=2, pid=8960 2024-07-04T03:20:00.610153173Z [2024-07-04T03:20:00.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:20:00+00:00, run_after=2024-07-04T03:25:00+00:00 2024-07-04T03:20:00.624512631Z [2024-07-04T03:20:00.624+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:20:00.639186858Z [2024-07-04T03:20:00.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:20:00+00:00, run_after=2024-07-04T03:21:00+00:00 2024-07-04T03:20:00.646514763Z [2024-07-04T03:20:00.646+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:20:00.800491009Z [2024-07-04T03:20:00.800+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T03:20:00.800520324Z 2024-07-04T03:20:00.800523992Z 2024-07-04T03:20:00.800532960Z 2024-07-04T03:20:00.800536692Z 2024-07-04T03:20:00.800595919Z [2024-07-04T03:20:00.800+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:20:00.800771774Z [2024-07-04T03:20:00.800+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:20:00.800942525Z [2024-07-04T03:20:00.800+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:20:00.801105578Z [2024-07-04T03:20:00.800+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:20:00.801830912Z [2024-07-04T03:20:00.801+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:20:00.801842822Z 2024-07-04T03:20:00.801846548Z 2024-07-04T03:20:00.801850074Z 2024-07-04T03:20:00.801853185Z 2024-07-04T03:20:00.806752141Z [2024-07-04T03:20:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:20:00.806978359Z [2024-07-04T03:20:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:20:00.807216222Z [2024-07-04T03:20:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:20:00.807313830Z [2024-07-04T03:20:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:20:00.807473850Z [2024-07-04T03:20:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:20:00.807552939Z [2024-07-04T03:20:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:20:00.807745127Z [2024-07-04T03:20:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:20:00.807809722Z [2024-07-04T03:20:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:20:01.431270650Z [2024-07-04T03:20:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status queued for try_number 1 2024-07-04T03:20:01.431696114Z [2024-07-04T03:20:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:18:00+00:00 exited with status queued for try_number 1 2024-07-04T03:20:01.431897977Z [2024-07-04T03:20:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:19:00+00:00 exited with status queued for try_number 1 2024-07-04T03:20:01.432110943Z [2024-07-04T03:20:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:19:00+00:00 exited with status queued for try_number 1 2024-07-04T03:20:01.453565209Z [2024-07-04T03:20:01.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd1beb25-d88f-4de1-9199-ec18f03a58eb 2024-07-04T03:20:01.454123438Z [2024-07-04T03:20:01.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66f34780-7291-4560-bae7-fbd95b9def2e 2024-07-04T03:20:01.454365904Z [2024-07-04T03:20:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to da56d930-ed9f-401c-b950-6b7616e5f6ec 2024-07-04T03:20:01.454588712Z [2024-07-04T03:20:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13008b32-1726-4f11-a20c-85ddf58daf02 2024-07-04T03:20:03.250231780Z [2024-07-04T03:20:03.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:20:03.250543630Z [2024-07-04T03:20:03.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:18:00+00:00, run_id=scheduled__2024-07-04T03:18:00+00:00, run_start_date=2024-07-04 03:20:00.675129+00:00, run_end_date=2024-07-04 03:20:03.250117+00:00, run_duration=2.574988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:18:00+00:00, data_interval_end=2024-07-04 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:20:03.261252379Z [2024-07-04T03:20:03.260+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:20:00+00:00, run_after=2024-07-04T03:22:00+00:00 2024-07-04T03:20:03.376580815Z [2024-07-04T03:20:03.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:18:00+00:00 exited with status success for try_number 1 2024-07-04T03:20:03.387351142Z [2024-07-04T03:20:03.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:18:00+00:00, map_index=-1, run_start_date=2024-07-04 03:20:02.152830+00:00, run_end_date=2024-07-04 03:20:02.648656+00:00, run_duration=0.495826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:20:00.803112+00:00, queued_by_job_id=2, pid=8997 2024-07-04T03:20:04.502535237Z [2024-07-04T03:20:04.501+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:20:04.502590847Z 2024-07-04T03:20:04.503181131Z [2024-07-04T03:20:04.502+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:20:04.504708748Z [2024-07-04T03:20:04.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:20:04.504735222Z 2024-07-04T03:20:04.510048331Z [2024-07-04T03:20:04.509+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:20:04.510506620Z [2024-07-04T03:20:04.509+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:20:04.580224687Z [2024-07-04T03:20:04.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status queued for try_number 1 2024-07-04T03:20:04.580270217Z [2024-07-04T03:20:04.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status success for try_number 1 2024-07-04T03:20:04.587793264Z [2024-07-04T03:20:04.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8cdfb0f-10d2-4e82-b79d-31181b6d8269 2024-07-04T03:20:04.588110537Z [2024-07-04T03:20:04.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:15:00+00:00, map_index=-1, run_start_date=2024-07-04 03:20:03.426174+00:00, run_end_date=2024-07-04 03:20:03.836168+00:00, run_duration=0.409994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:20:00.803112+00:00, queued_by_job_id=2, pid=9046 2024-07-04T03:20:05.804822839Z [2024-07-04T03:20:05.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:20:05.805125518Z [2024-07-04T03:20:05.804+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:19:00+00:00, run_id=scheduled__2024-07-04T03:19:00+00:00, run_start_date=2024-07-04 03:20:00.680102+00:00, run_end_date=2024-07-04 03:20:05.804647+00:00, run_duration=5.124545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:19:00+00:00, data_interval_end=2024-07-04 03:20:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:20:05.814042490Z [2024-07-04T03:20:05.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:20:00+00:00, run_after=2024-07-04T03:21:00+00:00 2024-07-04T03:20:05.820925282Z [2024-07-04T03:20:05.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:20:05.821260654Z [2024-07-04T03:20:05.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:19:00+00:00, run_id=scheduled__2024-07-04T03:19:00+00:00, run_start_date=2024-07-04 03:20:00.676421+00:00, run_end_date=2024-07-04 03:20:05.820798+00:00, run_duration=5.144377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:19:00+00:00, data_interval_end=2024-07-04 03:20:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:20:05.831158528Z [2024-07-04T03:20:05.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:20:00+00:00, run_after=2024-07-04T03:21:00+00:00 2024-07-04T03:20:05.876278694Z [2024-07-04T03:20:05.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:19:00+00:00 exited with status success for try_number 1 2024-07-04T03:20:05.876379414Z [2024-07-04T03:20:05.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:19:00+00:00 exited with status success for try_number 1 2024-07-04T03:20:05.885054085Z [2024-07-04T03:20:05.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:19:00+00:00, map_index=-1, run_start_date=2024-07-04 03:20:02.956262+00:00, run_end_date=2024-07-04 03:20:04.661620+00:00, run_duration=1.705358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:20:00.803112+00:00, queued_by_job_id=2, pid=9018 2024-07-04T03:20:05.885375801Z [2024-07-04T03:20:05.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:19:00+00:00, map_index=-1, run_start_date=2024-07-04 03:20:03.467028+00:00, run_end_date=2024-07-04 03:20:04.934223+00:00, run_duration=1.467195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:20:00.803112+00:00, queued_by_job_id=2, pid=9047 2024-07-04T03:20:07.268832194Z [2024-07-04T03:20:07.268+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:20:07.268899858Z 2024-07-04T03:20:07.269048499Z [2024-07-04T03:20:07.268+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:20:07.269724801Z [2024-07-04T03:20:07.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:20:07.269749393Z 2024-07-04T03:20:07.274153271Z [2024-07-04T03:20:07.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:20:07.274744977Z [2024-07-04T03:20:07.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:20:07.345468392Z [2024-07-04T03:20:07.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status queued for try_number 1 2024-07-04T03:20:07.345750302Z [2024-07-04T03:20:07.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status success for try_number 1 2024-07-04T03:20:07.356375830Z [2024-07-04T03:20:07.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 822248b0-22bc-44f3-90ee-dba733799830 2024-07-04T03:20:07.356834230Z [2024-07-04T03:20:07.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:15:00+00:00, map_index=-1, run_start_date=2024-07-04 03:20:06.277334+00:00, run_end_date=2024-07-04 03:20:06.745404+00:00, run_duration=0.46807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:20:04.505481+00:00, queued_by_job_id=2, pid=9077 2024-07-04T03:20:10.568945483Z [2024-07-04T03:20:10.568+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:20:10.568993154Z 2024-07-04T03:20:10.569137444Z [2024-07-04T03:20:10.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:20:10.570134378Z [2024-07-04T03:20:10.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:20:10.570153962Z 2024-07-04T03:20:10.577373103Z [2024-07-04T03:20:10.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:20:10.578099319Z [2024-07-04T03:20:10.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:20:10.631907810Z [2024-07-04T03:20:10.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status queued for try_number 1 2024-07-04T03:20:10.638489292Z [2024-07-04T03:20:10.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d887c24-7aa8-4af3-91aa-9d5f32765ff4 2024-07-04T03:20:10.734523389Z [2024-07-04T03:20:10.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status success for try_number 1 2024-07-04T03:20:10.742071449Z [2024-07-04T03:20:10.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:15:00+00:00, map_index=0, run_start_date=2024-07-04 03:20:09.062032+00:00, run_end_date=2024-07-04 03:20:10.469777+00:00, run_duration=1.407745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:20:07.270224+00:00, queued_by_job_id=2, pid=9089 2024-07-04T03:20:13.557711836Z [2024-07-04T03:20:13.557+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:20:13.557918518Z [2024-07-04T03:20:13.557+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:15:00+00:00, run_id=scheduled__2024-07-04T03:15:00+00:00, run_start_date=2024-07-04 03:20:00.672664+00:00, run_end_date=2024-07-04 03:20:13.557409+00:00, run_duration=12.884745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:15:00+00:00, data_interval_end=2024-07-04 03:20:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:20:13.567145448Z [2024-07-04T03:20:13.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:20:00+00:00, run_after=2024-07-04T03:25:00+00:00 2024-07-04T03:20:13.611631013Z [2024-07-04T03:20:13.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:15:00+00:00 exited with status success for try_number 1 2024-07-04T03:20:13.616617397Z [2024-07-04T03:20:13.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:15:00+00:00, map_index=-1, run_start_date=2024-07-04 03:20:12.317075+00:00, run_end_date=2024-07-04 03:20:12.741899+00:00, run_duration=0.424824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:20:10.570788+00:00, queued_by_job_id=2, pid=9110 2024-07-04T03:21:00.176927626Z [2024-07-04T03:21:00.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:21:00+00:00, run_after=2024-07-04T03:22:00+00:00 2024-07-04T03:21:00.184595625Z [2024-07-04T03:21:00.184+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:21:00.246440141Z [2024-07-04T03:21:00.246+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:21:00.246468590Z 2024-07-04T03:21:00.246472350Z 2024-07-04T03:21:00.247210063Z [2024-07-04T03:21:00.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:21:00.247498512Z [2024-07-04T03:21:00.247+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:21:00.248173588Z [2024-07-04T03:21:00.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:21:00.248185304Z 2024-07-04T03:21:00.248189039Z 2024-07-04T03:21:00.252891686Z [2024-07-04T03:21:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:21:00.253053584Z [2024-07-04T03:21:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:21:00.253469790Z [2024-07-04T03:21:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:21:00.253611767Z [2024-07-04T03:21:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:21:00.484082171Z [2024-07-04T03:21:00.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status queued for try_number 1 2024-07-04T03:21:00.486389935Z [2024-07-04T03:21:00.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status queued for try_number 1 2024-07-04T03:21:00.498228554Z [2024-07-04T03:21:00.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to a225b9ef-5f0a-41c3-8f1c-46061fab48e0 2024-07-04T03:21:00.498469873Z [2024-07-04T03:21:00.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 947cd3f5-2130-4589-9964-6491cb879f0c 2024-07-04T03:21:04.254396241Z [2024-07-04T03:21:04.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:21:04.255098890Z [2024-07-04T03:21:04.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:20:00+00:00, run_id=scheduled__2024-07-04T03:20:00+00:00, run_start_date=2024-07-04 03:21:00.195598+00:00, run_end_date=2024-07-04 03:21:04.254410+00:00, run_duration=4.058812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:20:00+00:00, data_interval_end=2024-07-04 03:21:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:21:04.267594065Z [2024-07-04T03:21:04.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:21:00+00:00, run_after=2024-07-04T03:22:00+00:00 2024-07-04T03:21:04.338571019Z [2024-07-04T03:21:04.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status success for try_number 1 2024-07-04T03:21:04.347704262Z [2024-07-04T03:21:04.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:20:00+00:00, map_index=-1, run_start_date=2024-07-04 03:21:02.119735+00:00, run_end_date=2024-07-04 03:21:03.358257+00:00, run_duration=1.238522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:21:00.248975+00:00, queued_by_job_id=2, pid=9137 2024-07-04T03:21:05.405125437Z [2024-07-04T03:21:05.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:21:05.405571034Z [2024-07-04T03:21:05.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:20:00+00:00, run_id=scheduled__2024-07-04T03:20:00+00:00, run_start_date=2024-07-04 03:21:00.197435+00:00, run_end_date=2024-07-04 03:21:05.404864+00:00, run_duration=5.207429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:20:00+00:00, data_interval_end=2024-07-04 03:21:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:21:05.428012877Z [2024-07-04T03:21:05.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:21:00+00:00, run_after=2024-07-04T03:22:00+00:00 2024-07-04T03:21:05.487498037Z [2024-07-04T03:21:05.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status success for try_number 1 2024-07-04T03:21:05.495667243Z [2024-07-04T03:21:05.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:20:00+00:00, map_index=-1, run_start_date=2024-07-04 03:21:02.460701+00:00, run_end_date=2024-07-04 03:21:04.345891+00:00, run_duration=1.88519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:21:00.248975+00:00, queued_by_job_id=2, pid=9156 2024-07-04T03:21:22.510628606Z [2024-07-04T03:21:22.510+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:22:00.051241683Z [2024-07-04T03:22:00.050+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:22:00.058442443Z [2024-07-04T03:22:00.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:22:00.077619208Z [2024-07-04T03:22:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:22:00+00:00, run_after=2024-07-04T03:23:00+00:00 2024-07-04T03:22:00.165199251Z [2024-07-04T03:22:00.164+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:22:00.165231479Z 2024-07-04T03:22:00.165240949Z 2024-07-04T03:22:00.165245731Z 2024-07-04T03:22:00.165298704Z [2024-07-04T03:22:00.165+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:22:00.165460072Z [2024-07-04T03:22:00.165+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:22:00.165625530Z [2024-07-04T03:22:00.165+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:22:00.166774831Z [2024-07-04T03:22:00.166+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:22:00.166788988Z 2024-07-04T03:22:00.166793892Z 2024-07-04T03:22:00.166798175Z 2024-07-04T03:22:00.171195429Z [2024-07-04T03:22:00.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:22:00.171256542Z [2024-07-04T03:22:00.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:22:00.171516236Z [2024-07-04T03:22:00.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:22:00.171601012Z [2024-07-04T03:22:00.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:22:00.171937793Z [2024-07-04T03:22:00.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:22:00.172035611Z [2024-07-04T03:22:00.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:22:00.645529339Z [2024-07-04T03:22:00.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status queued for try_number 1 2024-07-04T03:22:00.646341570Z [2024-07-04T03:22:00.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:21:00+00:00 exited with status queued for try_number 1 2024-07-04T03:22:00.651568612Z [2024-07-04T03:22:00.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:21:00+00:00 exited with status queued for try_number 1 2024-07-04T03:22:00.675940345Z [2024-07-04T03:22:00.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6de94269-f649-46ed-9878-d9587eba4f53 2024-07-04T03:22:00.676083673Z [2024-07-04T03:22:00.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 448b2916-4e33-4082-8b79-7ff30f0c92ee 2024-07-04T03:22:00.676247420Z [2024-07-04T03:22:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to f944da5d-0de6-4e7d-9c27-1c7b8a0698c7 2024-07-04T03:22:02.995247387Z [2024-07-04T03:22:02.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:22:02.995802379Z [2024-07-04T03:22:02.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:20:00+00:00, run_id=scheduled__2024-07-04T03:20:00+00:00, run_start_date=2024-07-04 03:22:00.089286+00:00, run_end_date=2024-07-04 03:22:02.995354+00:00, run_duration=2.906068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:20:00+00:00, data_interval_end=2024-07-04 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:22:03.005732188Z [2024-07-04T03:22:03.005+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:22:00+00:00, run_after=2024-07-04T03:24:00+00:00 2024-07-04T03:22:03.078556478Z [2024-07-04T03:22:03.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status success for try_number 1 2024-07-04T03:22:03.088310068Z [2024-07-04T03:22:03.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:20:00+00:00, map_index=-1, run_start_date=2024-07-04 03:22:01.397060+00:00, run_end_date=2024-07-04 03:22:01.830007+00:00, run_duration=0.432947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:22:00.167840+00:00, queued_by_job_id=2, pid=9183 2024-07-04T03:22:05.163066626Z [2024-07-04T03:22:05.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:22:05.163538959Z [2024-07-04T03:22:05.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:21:00+00:00, run_id=scheduled__2024-07-04T03:21:00+00:00, run_start_date=2024-07-04 03:22:00.090662+00:00, run_end_date=2024-07-04 03:22:05.162938+00:00, run_duration=5.072276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:21:00+00:00, data_interval_end=2024-07-04 03:22:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:22:05.173475533Z [2024-07-04T03:22:05.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:22:00+00:00, run_after=2024-07-04T03:23:00+00:00 2024-07-04T03:22:05.180545016Z [2024-07-04T03:22:05.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:22:05.180786207Z [2024-07-04T03:22:05.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:21:00+00:00, run_id=scheduled__2024-07-04T03:21:00+00:00, run_start_date=2024-07-04 03:22:00.091842+00:00, run_end_date=2024-07-04 03:22:05.180329+00:00, run_duration=5.088487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:21:00+00:00, data_interval_end=2024-07-04 03:22:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:22:05.191637315Z [2024-07-04T03:22:05.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:22:00+00:00, run_after=2024-07-04T03:23:00+00:00 2024-07-04T03:22:05.233529837Z [2024-07-04T03:22:05.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:21:00+00:00 exited with status success for try_number 1 2024-07-04T03:22:05.233586566Z [2024-07-04T03:22:05.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:21:00+00:00 exited with status success for try_number 1 2024-07-04T03:22:05.243038212Z [2024-07-04T03:22:05.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:21:00+00:00, map_index=-1, run_start_date=2024-07-04 03:22:02.347711+00:00, run_end_date=2024-07-04 03:22:04.102959+00:00, run_duration=1.755248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:22:00.167840+00:00, queued_by_job_id=2, pid=9203 2024-07-04T03:22:05.243393028Z [2024-07-04T03:22:05.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:21:00+00:00, map_index=-1, run_start_date=2024-07-04 03:22:02.707866+00:00, run_end_date=2024-07-04 03:22:04.417666+00:00, run_duration=1.7098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:22:00.167840+00:00, queued_by_job_id=2, pid=9222 2024-07-04T03:23:01.049207199Z [2024-07-04T03:23:01.048+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:23:01.072510583Z [2024-07-04T03:23:01.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:23:00+00:00, run_after=2024-07-04T03:24:00+00:00 2024-07-04T03:23:01.135586893Z [2024-07-04T03:23:01.135+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:23:01.135622467Z 2024-07-04T03:23:01.135627890Z 2024-07-04T03:23:01.135935201Z [2024-07-04T03:23:01.135+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:23:01.136056371Z [2024-07-04T03:23:01.135+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:23:01.136758451Z [2024-07-04T03:23:01.136+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:23:01.136778655Z 2024-07-04T03:23:01.136787524Z 2024-07-04T03:23:01.140047165Z [2024-07-04T03:23:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:23:01.140270405Z [2024-07-04T03:23:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:23:01.140561354Z [2024-07-04T03:23:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:23:01.140753912Z [2024-07-04T03:23:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:23:01.343044768Z [2024-07-04T03:23:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:22:00+00:00 exited with status queued for try_number 1 2024-07-04T03:23:01.343259901Z [2024-07-04T03:23:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:22:00+00:00 exited with status queued for try_number 1 2024-07-04T03:23:01.360051187Z [2024-07-04T03:23:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d64262a-4c49-4d1f-9877-5cf1939f782d 2024-07-04T03:23:01.360468067Z [2024-07-04T03:23:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93f40fb9-47c4-4878-b68e-e32ff8d42723 2024-07-04T03:23:04.742975578Z [2024-07-04T03:23:04.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:23:04.743005819Z [2024-07-04T03:23:04.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:22:00+00:00, run_id=scheduled__2024-07-04T03:22:00+00:00, run_start_date=2024-07-04 03:23:01.088873+00:00, run_end_date=2024-07-04 03:23:04.732675+00:00, run_duration=3.643802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:22:00+00:00, data_interval_end=2024-07-04 03:23:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:23:04.743010160Z [2024-07-04T03:23:04.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:23:00+00:00, run_after=2024-07-04T03:24:00+00:00 2024-07-04T03:23:04.785890507Z [2024-07-04T03:23:04.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:22:00+00:00 exited with status success for try_number 1 2024-07-04T03:23:04.791372825Z [2024-07-04T03:23:04.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:22:00+00:00, map_index=-1, run_start_date=2024-07-04 03:23:03.054595+00:00, run_end_date=2024-07-04 03:23:04.384884+00:00, run_duration=1.330289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:23:01.137422+00:00, queued_by_job_id=2, pid=9268 2024-07-04T03:23:06.151295729Z [2024-07-04T03:23:06.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:23:06.151440950Z [2024-07-04T03:23:06.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:22:00+00:00, run_id=scheduled__2024-07-04T03:22:00+00:00, run_start_date=2024-07-04 03:23:01.090776+00:00, run_end_date=2024-07-04 03:23:06.151127+00:00, run_duration=5.060351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:22:00+00:00, data_interval_end=2024-07-04 03:23:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:23:06.160059588Z [2024-07-04T03:23:06.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:23:00+00:00, run_after=2024-07-04T03:24:00+00:00 2024-07-04T03:23:06.207030232Z [2024-07-04T03:23:06.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:22:00+00:00 exited with status success for try_number 1 2024-07-04T03:23:06.214525767Z [2024-07-04T03:23:06.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:22:00+00:00, map_index=-1, run_start_date=2024-07-04 03:23:03.020441+00:00, run_end_date=2024-07-04 03:23:05.122415+00:00, run_duration=2.101974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:23:01.137422+00:00, queued_by_job_id=2, pid=9267 2024-07-04T03:24:00.234676349Z [2024-07-04T03:24:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:24:00+00:00, run_after=2024-07-04T03:25:00+00:00 2024-07-04T03:24:00.242335276Z [2024-07-04T03:24:00.242+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:24:00.251123842Z [2024-07-04T03:24:00.250+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:24:00.327418195Z [2024-07-04T03:24:00.327+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:24:00.327442728Z 2024-07-04T03:24:00.327446815Z 2024-07-04T03:24:00.327450016Z 2024-07-04T03:24:00.327546911Z [2024-07-04T03:24:00.327+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:24:00.327765814Z [2024-07-04T03:24:00.327+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:24:00.327891072Z [2024-07-04T03:24:00.327+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:24:00.328581150Z [2024-07-04T03:24:00.328+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:24:00.328592526Z 2024-07-04T03:24:00.328596291Z 2024-07-04T03:24:00.328613473Z 2024-07-04T03:24:00.337780029Z [2024-07-04T03:24:00.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:24:00.337956467Z [2024-07-04T03:24:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:24:00.338198379Z [2024-07-04T03:24:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:24:00.338331042Z [2024-07-04T03:24:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:24:00.338550404Z [2024-07-04T03:24:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:24:00.338752570Z [2024-07-04T03:24:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:24:00.992054004Z [2024-07-04T03:24:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:22:00+00:00 exited with status queued for try_number 1 2024-07-04T03:24:00.995200290Z [2024-07-04T03:24:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:23:00+00:00 exited with status queued for try_number 1 2024-07-04T03:24:00.996369195Z [2024-07-04T03:24:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:23:00+00:00 exited with status queued for try_number 1 2024-07-04T03:24:01.014524338Z [2024-07-04T03:24:01.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25cf65ee-d3d9-4ce3-8611-ecf0835452c7 2024-07-04T03:24:01.014830575Z [2024-07-04T03:24:01.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44db49fb-5947-46e6-b832-3dddd7dbf8b8 2024-07-04T03:24:01.015120933Z [2024-07-04T03:24:01.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99d9cfe8-1261-4b07-a028-80591c80a4e9 2024-07-04T03:24:02.367975623Z [2024-07-04T03:24:02.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:24:02.368357711Z [2024-07-04T03:24:02.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:22:00+00:00, run_id=scheduled__2024-07-04T03:22:00+00:00, run_start_date=2024-07-04 03:24:00.262435+00:00, run_end_date=2024-07-04 03:24:02.367865+00:00, run_duration=2.10543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:22:00+00:00, data_interval_end=2024-07-04 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:24:02.376364464Z [2024-07-04T03:24:02.376+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:24:00+00:00, run_after=2024-07-04T03:26:00+00:00 2024-07-04T03:24:02.447204586Z [2024-07-04T03:24:02.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:22:00+00:00 exited with status success for try_number 1 2024-07-04T03:24:02.456828408Z [2024-07-04T03:24:02.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:22:00+00:00, map_index=-1, run_start_date=2024-07-04 03:24:01.215459+00:00, run_end_date=2024-07-04 03:24:01.800495+00:00, run_duration=0.585036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:24:00.329291+00:00, queued_by_job_id=2, pid=9303 2024-07-04T03:24:04.612922336Z [2024-07-04T03:24:04.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:24:04.613189370Z [2024-07-04T03:24:04.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:23:00+00:00, run_id=scheduled__2024-07-04T03:23:00+00:00, run_start_date=2024-07-04 03:24:00.263797+00:00, run_end_date=2024-07-04 03:24:04.612822+00:00, run_duration=4.349025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:23:00+00:00, data_interval_end=2024-07-04 03:24:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:24:04.622163141Z [2024-07-04T03:24:04.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:24:00+00:00, run_after=2024-07-04T03:25:00+00:00 2024-07-04T03:24:04.664889789Z [2024-07-04T03:24:04.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:23:00+00:00 exited with status success for try_number 1 2024-07-04T03:24:04.672118116Z [2024-07-04T03:24:04.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:23:00+00:00, map_index=-1, run_start_date=2024-07-04 03:24:02.623471+00:00, run_end_date=2024-07-04 03:24:03.917039+00:00, run_duration=1.293568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:24:00.329291+00:00, queued_by_job_id=2, pid=9324 2024-07-04T03:24:05.726105544Z [2024-07-04T03:24:05.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:24:05.726418867Z [2024-07-04T03:24:05.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:23:00+00:00, run_id=scheduled__2024-07-04T03:23:00+00:00, run_start_date=2024-07-04 03:24:00.264888+00:00, run_end_date=2024-07-04 03:24:05.725912+00:00, run_duration=5.461024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:23:00+00:00, data_interval_end=2024-07-04 03:24:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:24:05.744559521Z [2024-07-04T03:24:05.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:24:00+00:00, run_after=2024-07-04T03:25:00+00:00 2024-07-04T03:24:05.796987547Z [2024-07-04T03:24:05.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:23:00+00:00 exited with status success for try_number 1 2024-07-04T03:24:05.805383682Z [2024-07-04T03:24:05.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:23:00+00:00, map_index=-1, run_start_date=2024-07-04 03:24:03.092306+00:00, run_end_date=2024-07-04 03:24:04.765505+00:00, run_duration=1.673199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:24:00.329291+00:00, queued_by_job_id=2, pid=9343 2024-07-04T03:25:00.880917590Z [2024-07-04T03:25:00.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:25:00+00:00, run_after=2024-07-04T03:30:00+00:00 2024-07-04T03:25:00.900336885Z [2024-07-04T03:25:00.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:25:00+00:00, run_after=2024-07-04T03:26:00+00:00 2024-07-04T03:25:00.909938699Z [2024-07-04T03:25:00.909+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:25:01.036849619Z [2024-07-04T03:25:01.036+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:25:01.036892958Z 2024-07-04T03:25:01.036903374Z 2024-07-04T03:25:01.036938645Z 2024-07-04T03:25:01.037044402Z [2024-07-04T03:25:01.036+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:25:01.037241888Z [2024-07-04T03:25:01.037+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:25:01.037423539Z [2024-07-04T03:25:01.037+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:25:01.038210485Z [2024-07-04T03:25:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:25:01.038234624Z 2024-07-04T03:25:01.038265649Z 2024-07-04T03:25:01.038274700Z 2024-07-04T03:25:01.043886444Z [2024-07-04T03:25:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:25:01.044254818Z [2024-07-04T03:25:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:25:01.044601986Z [2024-07-04T03:25:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:25:01.044802117Z [2024-07-04T03:25:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:25:01.045186001Z [2024-07-04T03:25:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:25:01.045361007Z [2024-07-04T03:25:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:25:01.311259139Z [2024-07-04T03:25:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status queued for try_number 1 2024-07-04T03:25:01.311593422Z [2024-07-04T03:25:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:24:00+00:00 exited with status queued for try_number 1 2024-07-04T03:25:01.311876772Z [2024-07-04T03:25:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:24:00+00:00 exited with status queued for try_number 1 2024-07-04T03:25:01.323182525Z [2024-07-04T03:25:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ad3fd85-12ce-409d-96b4-4b4351ba63d4 2024-07-04T03:25:01.323441195Z [2024-07-04T03:25:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49d3e535-d0d5-4ae5-9253-a882cb9b8182 2024-07-04T03:25:01.323648238Z [2024-07-04T03:25:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99156226-b84a-4ce1-ba53-dfbe4cb54979 2024-07-04T03:25:04.325162624Z [2024-07-04T03:25:04.324+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:25:04.325213747Z 2024-07-04T03:25:04.325341511Z [2024-07-04T03:25:04.324+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:25:04.325889527Z [2024-07-04T03:25:04.325+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:25:04.325902358Z 2024-07-04T03:25:04.328167363Z [2024-07-04T03:25:04.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:25:04.328395700Z [2024-07-04T03:25:04.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:25:04.388289404Z [2024-07-04T03:25:04.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status queued for try_number 1 2024-07-04T03:25:04.388313985Z [2024-07-04T03:25:04.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status success for try_number 1 2024-07-04T03:25:04.394048680Z [2024-07-04T03:25:04.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to d511c029-2a49-40e4-9929-a1ccfd4129bc 2024-07-04T03:25:04.394182280Z [2024-07-04T03:25:04.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:20:00+00:00, map_index=-1, run_start_date=2024-07-04 03:25:02.986115+00:00, run_end_date=2024-07-04 03:25:03.529860+00:00, run_duration=0.543745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:25:01.039295+00:00, queued_by_job_id=2, pid=9399 2024-07-04T03:25:05.548150534Z [2024-07-04T03:25:05.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:25:05.548758236Z [2024-07-04T03:25:05.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:24:00+00:00, run_id=scheduled__2024-07-04T03:24:00+00:00, run_start_date=2024-07-04 03:25:00.927717+00:00, run_end_date=2024-07-04 03:25:05.548006+00:00, run_duration=4.620289, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:24:00+00:00, data_interval_end=2024-07-04 03:25:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:25:05.562206047Z [2024-07-04T03:25:05.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:25:00+00:00, run_after=2024-07-04T03:26:00+00:00 2024-07-04T03:25:05.576281139Z [2024-07-04T03:25:05.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:25:05.577245310Z [2024-07-04T03:25:05.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:24:00+00:00, run_id=scheduled__2024-07-04T03:24:00+00:00, run_start_date=2024-07-04 03:25:00.929827+00:00, run_end_date=2024-07-04 03:25:05.576600+00:00, run_duration=4.646773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:24:00+00:00, data_interval_end=2024-07-04 03:25:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:25:05.596301339Z [2024-07-04T03:25:05.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:25:00+00:00, run_after=2024-07-04T03:26:00+00:00 2024-07-04T03:25:05.664924183Z [2024-07-04T03:25:05.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:24:00+00:00 exited with status success for try_number 1 2024-07-04T03:25:05.665416436Z [2024-07-04T03:25:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:24:00+00:00 exited with status success for try_number 1 2024-07-04T03:25:05.675720698Z [2024-07-04T03:25:05.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:24:00+00:00, map_index=-1, run_start_date=2024-07-04 03:25:03.263051+00:00, run_end_date=2024-07-04 03:25:04.629348+00:00, run_duration=1.366297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:25:01.039295+00:00, queued_by_job_id=2, pid=9400 2024-07-04T03:25:05.676903576Z [2024-07-04T03:25:05.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:24:00+00:00, map_index=-1, run_start_date=2024-07-04 03:25:02.959570+00:00, run_end_date=2024-07-04 03:25:04.835520+00:00, run_duration=1.87595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:25:01.039295+00:00, queued_by_job_id=2, pid=9396 2024-07-04T03:25:06.748005472Z [2024-07-04T03:25:06.747+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:25:06.748044179Z 2024-07-04T03:25:06.748186765Z [2024-07-04T03:25:06.747+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:25:06.748450091Z [2024-07-04T03:25:06.748+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:25:06.748462165Z 2024-07-04T03:25:06.750470220Z [2024-07-04T03:25:06.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:25:06.750515167Z [2024-07-04T03:25:06.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:25:06.818928384Z [2024-07-04T03:25:06.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status queued for try_number 1 2024-07-04T03:25:06.818986686Z [2024-07-04T03:25:06.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status success for try_number 1 2024-07-04T03:25:06.824810669Z [2024-07-04T03:25:06.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to d89eb5af-6ec6-4cd8-bffe-988f1eab3787 2024-07-04T03:25:06.824861577Z [2024-07-04T03:25:06.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:20:00+00:00, map_index=-1, run_start_date=2024-07-04 03:25:06.045131+00:00, run_end_date=2024-07-04 03:25:06.387191+00:00, run_duration=0.34206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:25:04.326256+00:00, queued_by_job_id=2, pid=9439 2024-07-04T03:25:09.904370620Z [2024-07-04T03:25:09.903+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:25:09.904412726Z 2024-07-04T03:25:09.904421272Z [2024-07-04T03:25:09.904+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:25:09.905171797Z [2024-07-04T03:25:09.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:25:09.905184948Z 2024-07-04T03:25:09.908777338Z [2024-07-04T03:25:09.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:25:09.909342490Z [2024-07-04T03:25:09.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:25:09.968958655Z [2024-07-04T03:25:09.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status queued for try_number 1 2024-07-04T03:25:09.969023543Z [2024-07-04T03:25:09.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status success for try_number 1 2024-07-04T03:25:09.977925813Z [2024-07-04T03:25:09.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06c70198-3c3e-4ba6-8056-0b7e65c49b1d 2024-07-04T03:25:09.978028938Z [2024-07-04T03:25:09.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:20:00+00:00, map_index=0, run_start_date=2024-07-04 03:25:08.326142+00:00, run_end_date=2024-07-04 03:25:09.645144+00:00, run_duration=1.319002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:25:06.748692+00:00, queued_by_job_id=2, pid=9450 2024-07-04T03:25:12.199936711Z [2024-07-04T03:25:12.199+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:25:12.200095328Z [2024-07-04T03:25:12.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:20:00+00:00, run_id=scheduled__2024-07-04T03:20:00+00:00, run_start_date=2024-07-04 03:25:00.925653+00:00, run_end_date=2024-07-04 03:25:12.199799+00:00, run_duration=11.274146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:20:00+00:00, data_interval_end=2024-07-04 03:25:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:25:12.206230234Z [2024-07-04T03:25:12.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:25:00+00:00, run_after=2024-07-04T03:30:00+00:00 2024-07-04T03:25:13.335204543Z [2024-07-04T03:25:13.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:20:00+00:00 exited with status success for try_number 1 2024-07-04T03:25:13.342175384Z [2024-07-04T03:25:13.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:20:00+00:00, map_index=-1, run_start_date=2024-07-04 03:25:11.645690+00:00, run_end_date=2024-07-04 03:25:12.079443+00:00, run_duration=0.433753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:25:09.905635+00:00, queued_by_job_id=2, pid=9471 2024-07-04T03:26:00.056024281Z [2024-07-04T03:26:00.055+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:26:00.074036899Z [2024-07-04T03:26:00.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:26:00+00:00, run_after=2024-07-04T03:27:00+00:00 2024-07-04T03:26:00.081798124Z [2024-07-04T03:26:00.081+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:26:00.146362154Z [2024-07-04T03:26:00.146+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:26:00.146386314Z 2024-07-04T03:26:00.146403824Z 2024-07-04T03:26:00.146407046Z 2024-07-04T03:26:00.146455083Z [2024-07-04T03:26:00.146+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:26:00.146628619Z [2024-07-04T03:26:00.146+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:26:00.146804465Z [2024-07-04T03:26:00.146+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:26:00.147559221Z [2024-07-04T03:26:00.147+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:26:00.147576392Z 2024-07-04T03:26:00.147580164Z 2024-07-04T03:26:00.147583232Z 2024-07-04T03:26:00.151147186Z [2024-07-04T03:26:00.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:26:00.152279065Z [2024-07-04T03:26:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:26:00.152753000Z [2024-07-04T03:26:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:26:00.152959569Z [2024-07-04T03:26:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:26:00.153264315Z [2024-07-04T03:26:00.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:26:00.153458910Z [2024-07-04T03:26:00.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:26:00.699345107Z [2024-07-04T03:26:00.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:24:00+00:00 exited with status queued for try_number 1 2024-07-04T03:26:00.699489514Z [2024-07-04T03:26:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status queued for try_number 1 2024-07-04T03:26:00.703596073Z [2024-07-04T03:26:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status queued for try_number 1 2024-07-04T03:26:00.715401120Z [2024-07-04T03:26:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2935b8e2-fef5-4265-8f71-c5965c193c9c 2024-07-04T03:26:00.715538549Z [2024-07-04T03:26:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3abb20ac-d726-4fd2-b175-490c578ecc7f 2024-07-04T03:26:00.715807788Z [2024-07-04T03:26:00.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9b65f70-a7c3-4357-a8aa-df67d1535640 2024-07-04T03:26:02.985987052Z [2024-07-04T03:26:02.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:26:02.986469309Z [2024-07-04T03:26:02.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:24:00+00:00, run_id=scheduled__2024-07-04T03:24:00+00:00, run_start_date=2024-07-04 03:26:00.091861+00:00, run_end_date=2024-07-04 03:26:02.985943+00:00, run_duration=2.894082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:24:00+00:00, data_interval_end=2024-07-04 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:26:02.994409818Z [2024-07-04T03:26:02.994+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:26:00+00:00, run_after=2024-07-04T03:28:00+00:00 2024-07-04T03:26:03.055300223Z [2024-07-04T03:26:03.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:24:00+00:00 exited with status success for try_number 1 2024-07-04T03:26:03.062532250Z [2024-07-04T03:26:03.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:24:00+00:00, map_index=-1, run_start_date=2024-07-04 03:26:01.197009+00:00, run_end_date=2024-07-04 03:26:02.039208+00:00, run_duration=0.842199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:26:00.148407+00:00, queued_by_job_id=2, pid=9489 2024-07-04T03:26:04.126019355Z [2024-07-04T03:26:04.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:26:04.126423980Z [2024-07-04T03:26:04.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:25:00+00:00, run_id=scheduled__2024-07-04T03:25:00+00:00, run_start_date=2024-07-04 03:26:00.093369+00:00, run_end_date=2024-07-04 03:26:04.125987+00:00, run_duration=4.032618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:25:00+00:00, data_interval_end=2024-07-04 03:26:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:26:04.137987998Z [2024-07-04T03:26:04.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:26:00+00:00, run_after=2024-07-04T03:27:00+00:00 2024-07-04T03:26:04.184562961Z [2024-07-04T03:26:04.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status success for try_number 1 2024-07-04T03:26:04.191129415Z [2024-07-04T03:26:04.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:25:00+00:00, map_index=-1, run_start_date=2024-07-04 03:26:02.647466+00:00, run_end_date=2024-07-04 03:26:03.946215+00:00, run_duration=1.298749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:26:00.148407+00:00, queued_by_job_id=2, pid=9520 2024-07-04T03:26:05.241049971Z [2024-07-04T03:26:05.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:26:05.241357166Z [2024-07-04T03:26:05.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:25:00+00:00, run_id=scheduled__2024-07-04T03:25:00+00:00, run_start_date=2024-07-04 03:26:00.094393+00:00, run_end_date=2024-07-04 03:26:05.240901+00:00, run_duration=5.146508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:25:00+00:00, data_interval_end=2024-07-04 03:26:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:26:05.251065623Z [2024-07-04T03:26:05.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:26:00+00:00, run_after=2024-07-04T03:27:00+00:00 2024-07-04T03:26:05.285645753Z [2024-07-04T03:26:05.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status success for try_number 1 2024-07-04T03:26:05.292813514Z [2024-07-04T03:26:05.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:25:00+00:00, map_index=-1, run_start_date=2024-07-04 03:26:02.534016+00:00, run_end_date=2024-07-04 03:26:04.236985+00:00, run_duration=1.702969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:26:00.148407+00:00, queued_by_job_id=2, pid=9519 2024-07-04T03:26:22.599307829Z [2024-07-04T03:26:22.598+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:26:36.724595654Z [2024-07-04T03:26:36.724+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:26:36.724635149Z 2024-07-04T03:26:36.724716577Z [2024-07-04T03:26:36.724+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-07-04T03:26:36.725261384Z [2024-07-04T03:26:36.725+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:26:36.725270757Z 2024-07-04T03:26:36.727595783Z [2024-07-04T03:26:36.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240704032636_200085', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:26:36.727771352Z [2024-07-04T03:26:36.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240704032636_200085', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-07-04T03:26:36.781509773Z [2024-07-04T03:26:36.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240704032636_200085 exited with status queued for try_number 1 2024-07-04T03:26:36.790251677Z [2024-07-04T03:26:36.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66e06dfd-fc17-4cc3-ba84-3271092f825d 2024-07-04T03:26:37.922776427Z [2024-07-04T03:26:37.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:26:37.923875184Z [2024-07-04T03:26:37.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-07-04 03:26:36.454604+00:00, run_id=scaleout_vdu_20240704032636_200085, run_start_date=2024-07-04 03:26:36.686704+00:00, run_end_date=2024-07-04 03:26:37.922669+00:00, run_duration=1.235965, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-07-04 03:26:36.454604+00:00, data_interval_end=2024-07-04 03:26:36.454604+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-07-04T03:26:37.929173421Z [2024-07-04T03:26:37.928+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-07-04T03:26:38.703650330Z [2024-07-04T03:26:38.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240704032636_200085 exited with status success for try_number 1 2024-07-04T03:26:38.712700255Z [2024-07-04T03:26:38.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240704032636_200085, map_index=-1, run_start_date=2024-07-04 03:26:37.418539+00:00, run_end_date=2024-07-04 03:26:37.904316+00:00, run_duration=0.485777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:26:36.725651+00:00, queued_by_job_id=2, pid=9540 2024-07-04T03:27:00.090135902Z [2024-07-04T03:27:00.089+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:27:00.106898701Z [2024-07-04T03:27:00.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:27:00+00:00, run_after=2024-07-04T03:28:00+00:00 2024-07-04T03:27:00.160464543Z [2024-07-04T03:27:00.159+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:27:00.160504748Z 2024-07-04T03:27:00.160508845Z 2024-07-04T03:27:00.160512117Z [2024-07-04T03:27:00.160+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:27:00.160761813Z [2024-07-04T03:27:00.160+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:27:00.161456409Z [2024-07-04T03:27:00.161+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:27:00.161484238Z 2024-07-04T03:27:00.161487758Z 2024-07-04T03:27:00.164368023Z [2024-07-04T03:27:00.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:27:00.164586029Z [2024-07-04T03:27:00.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:27:00.164965714Z [2024-07-04T03:27:00.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:27:00.165149401Z [2024-07-04T03:27:00.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:27:00.407198065Z [2024-07-04T03:27:00.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:26:00+00:00 exited with status queued for try_number 1 2024-07-04T03:27:00.407454201Z [2024-07-04T03:27:00.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:26:00+00:00 exited with status queued for try_number 1 2024-07-04T03:27:00.421287413Z [2024-07-04T03:27:00.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5eea59aa-3cc1-48dd-901b-846445d83646 2024-07-04T03:27:00.421617245Z [2024-07-04T03:27:00.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d06a5a8-64d4-4046-a89f-0eaf6aaab71e 2024-07-04T03:27:04.091552565Z [2024-07-04T03:27:04.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:27:04.091721975Z [2024-07-04T03:27:04.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:26:00+00:00, run_id=scheduled__2024-07-04T03:26:00+00:00, run_start_date=2024-07-04 03:27:00.118521+00:00, run_end_date=2024-07-04 03:27:04.091401+00:00, run_duration=3.97288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:26:00+00:00, data_interval_end=2024-07-04 03:27:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:27:04.101676745Z [2024-07-04T03:27:04.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:27:00+00:00, run_after=2024-07-04T03:28:00+00:00 2024-07-04T03:27:04.110633408Z [2024-07-04T03:27:04.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:27:04.110725950Z [2024-07-04T03:27:04.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:26:00+00:00, run_id=scheduled__2024-07-04T03:26:00+00:00, run_start_date=2024-07-04 03:27:00.120042+00:00, run_end_date=2024-07-04 03:27:04.110415+00:00, run_duration=3.990373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:26:00+00:00, data_interval_end=2024-07-04 03:27:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:27:04.119868844Z [2024-07-04T03:27:04.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:27:00+00:00, run_after=2024-07-04T03:28:00+00:00 2024-07-04T03:27:04.172635531Z [2024-07-04T03:27:04.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:26:00+00:00 exited with status success for try_number 1 2024-07-04T03:27:04.176915380Z [2024-07-04T03:27:04.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:26:00+00:00, map_index=-1, run_start_date=2024-07-04 03:27:02.321126+00:00, run_end_date=2024-07-04 03:27:03.713569+00:00, run_duration=1.392443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:27:00.162137+00:00, queued_by_job_id=2, pid=9586 2024-07-04T03:27:05.285256867Z [2024-07-04T03:27:05.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:26:00+00:00 exited with status success for try_number 1 2024-07-04T03:27:05.293006216Z [2024-07-04T03:27:05.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:26:00+00:00, map_index=-1, run_start_date=2024-07-04 03:27:02.438295+00:00, run_end_date=2024-07-04 03:27:04.034096+00:00, run_duration=1.595801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:27:00.162137+00:00, queued_by_job_id=2, pid=9587 2024-07-04T03:28:01.079924640Z [2024-07-04T03:28:01.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:28:01.093319501Z [2024-07-04T03:28:01.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:28:00+00:00, run_after=2024-07-04T03:29:00+00:00 2024-07-04T03:28:01.100821111Z [2024-07-04T03:28:01.100+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:28:01.185696640Z [2024-07-04T03:28:01.185+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:28:01.185728412Z 2024-07-04T03:28:01.185747276Z 2024-07-04T03:28:01.185750861Z 2024-07-04T03:28:01.186026493Z [2024-07-04T03:28:01.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:28:01.186259147Z [2024-07-04T03:28:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:28:01.186428506Z [2024-07-04T03:28:01.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:28:01.187126592Z [2024-07-04T03:28:01.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:28:01.187140833Z 2024-07-04T03:28:01.187146762Z 2024-07-04T03:28:01.187151707Z 2024-07-04T03:28:01.191674462Z [2024-07-04T03:28:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:28:01.192295849Z [2024-07-04T03:28:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:28:01.192623551Z [2024-07-04T03:28:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:28:01.192834359Z [2024-07-04T03:28:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:28:01.193193205Z [2024-07-04T03:28:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:28:01.193370719Z [2024-07-04T03:28:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:28:01.463882244Z [2024-07-04T03:28:01.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:26:00+00:00 exited with status queued for try_number 1 2024-07-04T03:28:01.464135033Z [2024-07-04T03:28:01.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:27:00+00:00 exited with status queued for try_number 1 2024-07-04T03:28:01.464376701Z [2024-07-04T03:28:01.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:27:00+00:00 exited with status queued for try_number 1 2024-07-04T03:28:01.496903384Z [2024-07-04T03:28:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fcf9ac6-48c2-410f-9e0e-a01cc2205b53 2024-07-04T03:28:01.499655035Z [2024-07-04T03:28:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83118b8f-0646-4f86-b63f-04e041b09fda 2024-07-04T03:28:01.499746613Z [2024-07-04T03:28:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28618fab-5703-449d-bda4-e5f6ad1b1486 2024-07-04T03:28:02.685305665Z [2024-07-04T03:28:02.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:28:02.685723635Z [2024-07-04T03:28:02.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:26:00+00:00, run_id=scheduled__2024-07-04T03:26:00+00:00, run_start_date=2024-07-04 03:28:01.110926+00:00, run_end_date=2024-07-04 03:28:02.685246+00:00, run_duration=1.57432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:26:00+00:00, data_interval_end=2024-07-04 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:28:02.706205184Z [2024-07-04T03:28:02.705+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:28:00+00:00, run_after=2024-07-04T03:30:00+00:00 2024-07-04T03:28:02.775184211Z [2024-07-04T03:28:02.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:26:00+00:00 exited with status success for try_number 1 2024-07-04T03:28:02.781789066Z [2024-07-04T03:28:02.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:26:00+00:00, map_index=-1, run_start_date=2024-07-04 03:28:02.032552+00:00, run_end_date=2024-07-04 03:28:02.395873+00:00, run_duration=0.363321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:28:01.188299+00:00, queued_by_job_id=2, pid=9622 2024-07-04T03:28:06.222411229Z [2024-07-04T03:28:06.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:28:06.223270984Z [2024-07-04T03:28:06.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:27:00+00:00, run_id=scheduled__2024-07-04T03:27:00+00:00, run_start_date=2024-07-04 03:28:01.112348+00:00, run_end_date=2024-07-04 03:28:06.222422+00:00, run_duration=5.110074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:27:00+00:00, data_interval_end=2024-07-04 03:28:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:28:06.241895652Z [2024-07-04T03:28:06.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:28:00+00:00, run_after=2024-07-04T03:29:00+00:00 2024-07-04T03:28:06.249675383Z [2024-07-04T03:28:06.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:28:06.250046230Z [2024-07-04T03:28:06.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:27:00+00:00, run_id=scheduled__2024-07-04T03:27:00+00:00, run_start_date=2024-07-04 03:28:01.113420+00:00, run_end_date=2024-07-04 03:28:06.249642+00:00, run_duration=5.136222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:27:00+00:00, data_interval_end=2024-07-04 03:28:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:28:06.261055843Z [2024-07-04T03:28:06.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:28:00+00:00, run_after=2024-07-04T03:29:00+00:00 2024-07-04T03:28:06.300228515Z [2024-07-04T03:28:06.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:27:00+00:00 exited with status success for try_number 1 2024-07-04T03:28:06.300384775Z [2024-07-04T03:28:06.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:27:00+00:00 exited with status success for try_number 1 2024-07-04T03:28:06.309912570Z [2024-07-04T03:28:06.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:27:00+00:00, map_index=-1, run_start_date=2024-07-04 03:28:03.366455+00:00, run_end_date=2024-07-04 03:28:05.482371+00:00, run_duration=2.115916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:28:01.188299+00:00, queued_by_job_id=2, pid=9652 2024-07-04T03:28:06.310401889Z [2024-07-04T03:28:06.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:27:00+00:00, map_index=-1, run_start_date=2024-07-04 03:28:03.278653+00:00, run_end_date=2024-07-04 03:28:05.966012+00:00, run_duration=2.687359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:28:01.188299+00:00, queued_by_job_id=2, pid=9651 2024-07-04T03:29:01.033505767Z [2024-07-04T03:29:01.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:29:00+00:00, run_after=2024-07-04T03:30:00+00:00 2024-07-04T03:29:01.041337839Z [2024-07-04T03:29:01.040+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:29:01.097641580Z [2024-07-04T03:29:01.097+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:29:01.097668286Z 2024-07-04T03:29:01.097671928Z 2024-07-04T03:29:01.097985034Z [2024-07-04T03:29:01.097+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:29:01.098199814Z [2024-07-04T03:29:01.098+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:29:01.098913355Z [2024-07-04T03:29:01.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:29:01.098926128Z 2024-07-04T03:29:01.098929512Z 2024-07-04T03:29:01.102053185Z [2024-07-04T03:29:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:29:01.102275262Z [2024-07-04T03:29:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:29:01.102621843Z [2024-07-04T03:29:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:29:01.102833271Z [2024-07-04T03:29:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:29:01.297452449Z [2024-07-04T03:29:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:28:00+00:00 exited with status queued for try_number 1 2024-07-04T03:29:01.299586649Z [2024-07-04T03:29:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:28:00+00:00 exited with status queued for try_number 1 2024-07-04T03:29:01.313815175Z [2024-07-04T03:29:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fc437a9-84d4-4369-ad33-8d8e93a42294 2024-07-04T03:29:01.313870697Z [2024-07-04T03:29:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fe4122f-85b9-47ca-8385-a3e4864237d8 2024-07-04T03:29:05.335623927Z [2024-07-04T03:29:05.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:29:05.336189401Z [2024-07-04T03:29:05.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:28:00+00:00, run_id=scheduled__2024-07-04T03:28:00+00:00, run_start_date=2024-07-04 03:29:01.050945+00:00, run_end_date=2024-07-04 03:29:05.335510+00:00, run_duration=4.284565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:28:00+00:00, data_interval_end=2024-07-04 03:29:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:29:05.347166589Z [2024-07-04T03:29:05.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:29:00+00:00, run_after=2024-07-04T03:30:00+00:00 2024-07-04T03:29:05.382371083Z [2024-07-04T03:29:05.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:28:00+00:00 exited with status success for try_number 1 2024-07-04T03:29:05.389305500Z [2024-07-04T03:29:05.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:28:00+00:00, map_index=-1, run_start_date=2024-07-04 03:29:02.986261+00:00, run_end_date=2024-07-04 03:29:04.785056+00:00, run_duration=1.798795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:29:01.099577+00:00, queued_by_job_id=2, pid=9707 2024-07-04T03:29:06.407430218Z [2024-07-04T03:29:06.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:29:06.407623152Z [2024-07-04T03:29:06.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:28:00+00:00, run_id=scheduled__2024-07-04T03:28:00+00:00, run_start_date=2024-07-04 03:29:01.052329+00:00, run_end_date=2024-07-04 03:29:06.407175+00:00, run_duration=5.354846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:28:00+00:00, data_interval_end=2024-07-04 03:29:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:29:06.420600099Z [2024-07-04T03:29:06.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:29:00+00:00, run_after=2024-07-04T03:30:00+00:00 2024-07-04T03:29:06.468379128Z [2024-07-04T03:29:06.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:28:00+00:00 exited with status success for try_number 1 2024-07-04T03:29:06.476371995Z [2024-07-04T03:29:06.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:28:00+00:00, map_index=-1, run_start_date=2024-07-04 03:29:02.929938+00:00, run_end_date=2024-07-04 03:29:05.228360+00:00, run_duration=2.298422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:29:01.099577+00:00, queued_by_job_id=2, pid=9706 2024-07-04T03:30:00.218582593Z [2024-07-04T03:30:00.218+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:30:00.254049262Z [2024-07-04T03:30:00.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:30:00+00:00, run_after=2024-07-04T03:31:00+00:00 2024-07-04T03:30:00.280124017Z [2024-07-04T03:30:00.279+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:30:00.307009466Z [2024-07-04T03:30:00.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:30:00+00:00, run_after=2024-07-04T03:35:00+00:00 2024-07-04T03:30:00.428860332Z [2024-07-04T03:30:00.428+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T03:30:00.428895432Z 2024-07-04T03:30:00.428899426Z 2024-07-04T03:30:00.428903940Z 2024-07-04T03:30:00.428907524Z 2024-07-04T03:30:00.428910962Z [2024-07-04T03:30:00.428+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:30:00.428925217Z [2024-07-04T03:30:00.428+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:30:00.429021628Z [2024-07-04T03:30:00.428+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:30:00.429056876Z [2024-07-04T03:30:00.428+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:30:00.429718695Z [2024-07-04T03:30:00.429+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:30:00.429731017Z 2024-07-04T03:30:00.429734641Z 2024-07-04T03:30:00.429738718Z 2024-07-04T03:30:00.429741911Z 2024-07-04T03:30:00.434011789Z [2024-07-04T03:30:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:30:00.434063619Z [2024-07-04T03:30:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:30:00.434278214Z [2024-07-04T03:30:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:30:00.434312927Z [2024-07-04T03:30:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:30:00.434513669Z [2024-07-04T03:30:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:30:00.434628806Z [2024-07-04T03:30:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:30:00.434819315Z [2024-07-04T03:30:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:30:00.434889108Z [2024-07-04T03:30:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:30:00.937647979Z [2024-07-04T03:30:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status queued for try_number 1 2024-07-04T03:30:00.937940569Z [2024-07-04T03:30:00.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:28:00+00:00 exited with status queued for try_number 1 2024-07-04T03:30:00.938124524Z [2024-07-04T03:30:00.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:29:00+00:00 exited with status queued for try_number 1 2024-07-04T03:30:00.938307079Z [2024-07-04T03:30:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:29:00+00:00 exited with status queued for try_number 1 2024-07-04T03:30:00.952910299Z [2024-07-04T03:30:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9fbd846-8cc1-47e6-b967-335f096a72ee 2024-07-04T03:30:00.953141903Z [2024-07-04T03:30:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd0bafbb-d5ea-45d9-9fe7-d1fbdd3667e0 2024-07-04T03:30:00.953336964Z [2024-07-04T03:30:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 121e57dc-9d92-4c2f-b69a-75bf31e61412 2024-07-04T03:30:00.953569856Z [2024-07-04T03:30:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7341958d-6559-447c-b216-13f9daa54d04 2024-07-04T03:30:02.337225934Z [2024-07-04T03:30:02.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:30:02.337720728Z [2024-07-04T03:30:02.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:28:00+00:00, run_id=scheduled__2024-07-04T03:28:00+00:00, run_start_date=2024-07-04 03:30:00.339777+00:00, run_end_date=2024-07-04 03:30:02.337167+00:00, run_duration=1.99739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:28:00+00:00, data_interval_end=2024-07-04 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:30:02.346734200Z [2024-07-04T03:30:02.346+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:30:00+00:00, run_after=2024-07-04T03:32:00+00:00 2024-07-04T03:30:02.422083609Z [2024-07-04T03:30:02.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:28:00+00:00 exited with status success for try_number 1 2024-07-04T03:30:02.430763802Z [2024-07-04T03:30:02.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:28:00+00:00, map_index=-1, run_start_date=2024-07-04 03:30:01.422263+00:00, run_end_date=2024-07-04 03:30:02.107253+00:00, run_duration=0.68499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:30:00.430610+00:00, queued_by_job_id=2, pid=9743 2024-07-04T03:30:03.617316164Z [2024-07-04T03:30:03.616+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:30:03.617334561Z 2024-07-04T03:30:03.617338564Z [2024-07-04T03:30:03.617+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:30:03.617904291Z [2024-07-04T03:30:03.617+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:30:03.617914781Z 2024-07-04T03:30:03.620717977Z [2024-07-04T03:30:03.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:30:03.620806799Z [2024-07-04T03:30:03.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:30:03.734040650Z [2024-07-04T03:30:03.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status queued for try_number 1 2024-07-04T03:30:03.734225359Z [2024-07-04T03:30:03.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status success for try_number 1 2024-07-04T03:30:03.748503475Z [2024-07-04T03:30:03.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cef7d72-6439-46e5-9ea8-0a16f388cf22 2024-07-04T03:30:03.748561856Z [2024-07-04T03:30:03.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:25:00+00:00, map_index=-1, run_start_date=2024-07-04 03:30:02.927545+00:00, run_end_date=2024-07-04 03:30:03.384887+00:00, run_duration=0.457342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:30:00.430610+00:00, queued_by_job_id=2, pid=9764 2024-07-04T03:30:06.074010247Z [2024-07-04T03:30:06.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:30:06.074269433Z [2024-07-04T03:30:06.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:29:00+00:00, run_id=scheduled__2024-07-04T03:29:00+00:00, run_start_date=2024-07-04 03:30:00.341834+00:00, run_end_date=2024-07-04 03:30:06.073919+00:00, run_duration=5.732085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:29:00+00:00, data_interval_end=2024-07-04 03:30:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:30:06.085968284Z [2024-07-04T03:30:06.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:30:00+00:00, run_after=2024-07-04T03:31:00+00:00 2024-07-04T03:30:06.095702081Z [2024-07-04T03:30:06.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:30:06.097061573Z [2024-07-04T03:30:06.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:29:00+00:00, run_id=scheduled__2024-07-04T03:29:00+00:00, run_start_date=2024-07-04 03:30:00.340841+00:00, run_end_date=2024-07-04 03:30:06.096611+00:00, run_duration=5.75577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:29:00+00:00, data_interval_end=2024-07-04 03:30:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:30:06.114902498Z [2024-07-04T03:30:06.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:30:00+00:00, run_after=2024-07-04T03:31:00+00:00 2024-07-04T03:30:06.197908443Z [2024-07-04T03:30:06.197+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:30:06.197944351Z 2024-07-04T03:30:06.197950632Z [2024-07-04T03:30:06.197+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:30:06.198811120Z [2024-07-04T03:30:06.198+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:30:06.198827093Z 2024-07-04T03:30:06.201185821Z [2024-07-04T03:30:06.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:30:06.201404115Z [2024-07-04T03:30:06.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:30:06.272864045Z [2024-07-04T03:30:06.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status queued for try_number 1 2024-07-04T03:30:06.272933298Z [2024-07-04T03:30:06.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:29:00+00:00 exited with status success for try_number 1 2024-07-04T03:30:06.273042722Z [2024-07-04T03:30:06.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:29:00+00:00 exited with status success for try_number 1 2024-07-04T03:30:06.273158798Z [2024-07-04T03:30:06.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status success for try_number 1 2024-07-04T03:30:06.288509734Z [2024-07-04T03:30:06.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:29:00+00:00, map_index=-1, run_start_date=2024-07-04 03:30:03.473627+00:00, run_end_date=2024-07-04 03:30:05.283103+00:00, run_duration=1.809476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:30:00.430610+00:00, queued_by_job_id=2, pid=9792 2024-07-04T03:30:06.288634885Z [2024-07-04T03:30:06.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20816f8b-cbab-4b63-a934-25c8e56d4cb6 2024-07-04T03:30:06.288841719Z [2024-07-04T03:30:06.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:25:00+00:00, map_index=-1, run_start_date=2024-07-04 03:30:05.654562+00:00, run_end_date=2024-07-04 03:30:06.074303+00:00, run_duration=0.419741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:30:03.618185+00:00, queued_by_job_id=2, pid=9823 2024-07-04T03:30:06.289000127Z [2024-07-04T03:30:06.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:29:00+00:00, map_index=-1, run_start_date=2024-07-04 03:30:03.728095+00:00, run_end_date=2024-07-04 03:30:05.221689+00:00, run_duration=1.493594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:30:00.430610+00:00, queued_by_job_id=2, pid=9794 2024-07-04T03:30:09.728176260Z [2024-07-04T03:30:09.727+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:30:09.728204049Z 2024-07-04T03:30:09.728301348Z [2024-07-04T03:30:09.728+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:30:09.728871945Z [2024-07-04T03:30:09.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:30:09.728901047Z 2024-07-04T03:30:09.731730922Z [2024-07-04T03:30:09.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:30:09.731751376Z [2024-07-04T03:30:09.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:30:09.788537733Z [2024-07-04T03:30:09.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status queued for try_number 1 2024-07-04T03:30:09.796870919Z [2024-07-04T03:30:09.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41bfdb4c-d4ff-469e-adab-f5f717e856a7 2024-07-04T03:30:09.900430321Z [2024-07-04T03:30:09.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status success for try_number 1 2024-07-04T03:30:09.913453557Z [2024-07-04T03:30:09.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:25:00+00:00, map_index=0, run_start_date=2024-07-04 03:30:07.844950+00:00, run_end_date=2024-07-04 03:30:09.653572+00:00, run_duration=1.808622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:30:06.199281+00:00, queued_by_job_id=2, pid=9835 2024-07-04T03:30:12.064474366Z [2024-07-04T03:30:12.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:30:12.064722798Z [2024-07-04T03:30:12.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:25:00+00:00, run_id=scheduled__2024-07-04T03:25:00+00:00, run_start_date=2024-07-04 03:30:00.338415+00:00, run_end_date=2024-07-04 03:30:12.064376+00:00, run_duration=11.725961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:25:00+00:00, data_interval_end=2024-07-04 03:30:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:30:12.071260460Z [2024-07-04T03:30:12.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:30:00+00:00, run_after=2024-07-04T03:35:00+00:00 2024-07-04T03:30:12.106140355Z [2024-07-04T03:30:12.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:25:00+00:00 exited with status success for try_number 1 2024-07-04T03:30:12.113289990Z [2024-07-04T03:30:12.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:25:00+00:00, map_index=-1, run_start_date=2024-07-04 03:30:11.443042+00:00, run_end_date=2024-07-04 03:30:11.874970+00:00, run_duration=0.431928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:30:09.729270+00:00, queued_by_job_id=2, pid=9856 2024-07-04T03:31:00.452226714Z [2024-07-04T03:31:00.451+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:31:00.465344716Z [2024-07-04T03:31:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:31:00+00:00, run_after=2024-07-04T03:32:00+00:00 2024-07-04T03:31:00.518401157Z [2024-07-04T03:31:00.517+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:31:00.518445766Z 2024-07-04T03:31:00.518456060Z 2024-07-04T03:31:00.518479955Z [2024-07-04T03:31:00.518+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:31:00.518634159Z [2024-07-04T03:31:00.518+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:31:00.519367447Z [2024-07-04T03:31:00.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:31:00.519392763Z 2024-07-04T03:31:00.519420349Z 2024-07-04T03:31:00.522434855Z [2024-07-04T03:31:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:31:00.522553881Z [2024-07-04T03:31:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:31:00.523773994Z [2024-07-04T03:31:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:31:00.523898385Z [2024-07-04T03:31:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:31:00.744409444Z [2024-07-04T03:31:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status queued for try_number 1 2024-07-04T03:31:00.744810937Z [2024-07-04T03:31:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status queued for try_number 1 2024-07-04T03:31:00.769312680Z [2024-07-04T03:31:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to affdf8a8-92ad-4a17-9e66-5ff520c823f2 2024-07-04T03:31:00.769937062Z [2024-07-04T03:31:00.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8c5382b-42e8-4bdf-98a3-a9f3445680e7 2024-07-04T03:31:05.656552064Z [2024-07-04T03:31:05.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:31:05.656969687Z [2024-07-04T03:31:05.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:30:00+00:00, run_id=scheduled__2024-07-04T03:30:00+00:00, run_start_date=2024-07-04 03:31:00.476673+00:00, run_end_date=2024-07-04 03:31:05.656531+00:00, run_duration=5.179858, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:30:00+00:00, data_interval_end=2024-07-04 03:31:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:31:05.668975583Z [2024-07-04T03:31:05.668+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:31:00+00:00, run_after=2024-07-04T03:32:00+00:00 2024-07-04T03:31:05.719983112Z [2024-07-04T03:31:05.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status success for try_number 1 2024-07-04T03:31:05.727867228Z [2024-07-04T03:31:05.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:30:00+00:00, map_index=-1, run_start_date=2024-07-04 03:31:02.660198+00:00, run_end_date=2024-07-04 03:31:04.992089+00:00, run_duration=2.331891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:31:00.519882+00:00, queued_by_job_id=2, pid=9892 2024-07-04T03:31:06.789510237Z [2024-07-04T03:31:06.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:31:06.789956617Z [2024-07-04T03:31:06.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:30:00+00:00, run_id=scheduled__2024-07-04T03:30:00+00:00, run_start_date=2024-07-04 03:31:00.478184+00:00, run_end_date=2024-07-04 03:31:06.789447+00:00, run_duration=6.311263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:30:00+00:00, data_interval_end=2024-07-04 03:31:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:31:06.807380773Z [2024-07-04T03:31:06.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:31:00+00:00, run_after=2024-07-04T03:32:00+00:00 2024-07-04T03:31:06.834864648Z [2024-07-04T03:31:06.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status success for try_number 1 2024-07-04T03:31:06.839777753Z [2024-07-04T03:31:06.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:30:00+00:00, map_index=-1, run_start_date=2024-07-04 03:31:02.682349+00:00, run_end_date=2024-07-04 03:31:05.727062+00:00, run_duration=3.044713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:31:00.519882+00:00, queued_by_job_id=2, pid=9893 2024-07-04T03:31:22.672033910Z [2024-07-04T03:31:22.671+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:32:00.520275675Z [2024-07-04T03:32:00.519+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:32:00.530088922Z [2024-07-04T03:32:00.529+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:32:00.545155831Z [2024-07-04T03:32:00.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:32:00+00:00, run_after=2024-07-04T03:33:00+00:00 2024-07-04T03:32:00.624587964Z [2024-07-04T03:32:00.624+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:32:00.624631910Z 2024-07-04T03:32:00.624641226Z 2024-07-04T03:32:00.624648316Z 2024-07-04T03:32:00.624666447Z [2024-07-04T03:32:00.624+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:32:00.624818435Z [2024-07-04T03:32:00.624+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:32:00.624896544Z [2024-07-04T03:32:00.624+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:32:00.625772753Z [2024-07-04T03:32:00.625+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:32:00.625791513Z 2024-07-04T03:32:00.625799845Z 2024-07-04T03:32:00.625807338Z 2024-07-04T03:32:00.631701762Z [2024-07-04T03:32:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:32:00.631852403Z [2024-07-04T03:32:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:32:00.632242511Z [2024-07-04T03:32:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:32:00.632350221Z [2024-07-04T03:32:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:32:00.632658955Z [2024-07-04T03:32:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:32:00.632842187Z [2024-07-04T03:32:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:32:00.901826244Z [2024-07-04T03:32:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status queued for try_number 1 2024-07-04T03:32:00.905388002Z [2024-07-04T03:32:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:31:00+00:00 exited with status queued for try_number 1 2024-07-04T03:32:00.905602007Z [2024-07-04T03:32:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:31:00+00:00 exited with status queued for try_number 1 2024-07-04T03:32:00.929292585Z [2024-07-04T03:32:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90177e1f-d31f-4e2c-9954-84cb67b19559 2024-07-04T03:32:00.935212351Z [2024-07-04T03:32:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a1ce925-111d-45f4-96de-77f3c2a4d3b5 2024-07-04T03:32:00.935585157Z [2024-07-04T03:32:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18a7909b-1284-4500-81e7-57834b89c3d3 2024-07-04T03:32:02.263930843Z [2024-07-04T03:32:02.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:32:02.264397930Z [2024-07-04T03:32:02.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:30:00+00:00, run_id=scheduled__2024-07-04T03:30:00+00:00, run_start_date=2024-07-04 03:32:00.557673+00:00, run_end_date=2024-07-04 03:32:02.263943+00:00, run_duration=1.70627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:30:00+00:00, data_interval_end=2024-07-04 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:32:02.273131416Z [2024-07-04T03:32:02.272+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:32:00+00:00, run_after=2024-07-04T03:34:00+00:00 2024-07-04T03:32:02.345850779Z [2024-07-04T03:32:02.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status success for try_number 1 2024-07-04T03:32:02.356561605Z [2024-07-04T03:32:02.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:30:00+00:00, map_index=-1, run_start_date=2024-07-04 03:32:01.449591+00:00, run_end_date=2024-07-04 03:32:01.853209+00:00, run_duration=0.403618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:32:00.627717+00:00, queued_by_job_id=2, pid=9928 2024-07-04T03:32:04.507834230Z [2024-07-04T03:32:04.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:32:04.508283115Z [2024-07-04T03:32:04.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:31:00+00:00, run_id=scheduled__2024-07-04T03:31:00+00:00, run_start_date=2024-07-04 03:32:00.558928+00:00, run_end_date=2024-07-04 03:32:04.507778+00:00, run_duration=3.94885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:31:00+00:00, data_interval_end=2024-07-04 03:32:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:32:04.520094661Z [2024-07-04T03:32:04.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:32:00+00:00, run_after=2024-07-04T03:33:00+00:00 2024-07-04T03:32:04.566820140Z [2024-07-04T03:32:04.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:31:00+00:00 exited with status success for try_number 1 2024-07-04T03:32:04.575959001Z [2024-07-04T03:32:04.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:31:00+00:00, map_index=-1, run_start_date=2024-07-04 03:32:02.763017+00:00, run_end_date=2024-07-04 03:32:04.117427+00:00, run_duration=1.35441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:32:00.627717+00:00, queued_by_job_id=2, pid=9958 2024-07-04T03:32:05.641528126Z [2024-07-04T03:32:05.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:32:05.641747643Z [2024-07-04T03:32:05.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:31:00+00:00, run_id=scheduled__2024-07-04T03:31:00+00:00, run_start_date=2024-07-04 03:32:00.559980+00:00, run_end_date=2024-07-04 03:32:05.641207+00:00, run_duration=5.081227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:31:00+00:00, data_interval_end=2024-07-04 03:32:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:32:05.654641302Z [2024-07-04T03:32:05.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:32:00+00:00, run_after=2024-07-04T03:33:00+00:00 2024-07-04T03:32:05.699547596Z [2024-07-04T03:32:05.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:31:00+00:00 exited with status success for try_number 1 2024-07-04T03:32:05.705512947Z [2024-07-04T03:32:05.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:31:00+00:00, map_index=-1, run_start_date=2024-07-04 03:32:02.762191+00:00, run_end_date=2024-07-04 03:32:04.974036+00:00, run_duration=2.211845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:32:00.627717+00:00, queued_by_job_id=2, pid=9957 2024-07-04T03:32:37.250986136Z [2024-07-04T03:32:37.250+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:32:37.251039138Z 2024-07-04T03:32:37.251153364Z [2024-07-04T03:32:37.250+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-07-04T03:32:37.252407855Z [2024-07-04T03:32:37.252+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:32:37.252432786Z 2024-07-04T03:32:37.256869025Z [2024-07-04T03:32:37.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240704033236_572398', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:32:37.257214027Z [2024-07-04T03:32:37.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240704033236_572398', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-07-04T03:32:37.313925881Z [2024-07-04T03:32:37.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240704033236_572398 exited with status queued for try_number 1 2024-07-04T03:32:37.322561239Z [2024-07-04T03:32:37.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5dff997-6889-4976-846e-8a0052fba713 2024-07-04T03:32:38.487571231Z [2024-07-04T03:32:38.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:32:38.490141199Z [2024-07-04T03:32:38.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-07-04 03:32:36.510266+00:00, run_id=scaleout_vdu_20240704033236_572398, run_start_date=2024-07-04 03:32:37.202417+00:00, run_end_date=2024-07-04 03:32:38.488029+00:00, run_duration=1.285612, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-07-04 03:32:36.510266+00:00, data_interval_end=2024-07-04 03:32:36.510266+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-07-04T03:32:38.496357113Z [2024-07-04T03:32:38.496+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-07-04T03:32:39.663939189Z [2024-07-04T03:32:39.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240704033236_572398 exited with status success for try_number 1 2024-07-04T03:32:39.671460355Z [2024-07-04T03:32:39.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240704033236_572398, map_index=-1, run_start_date=2024-07-04 03:32:38.026224+00:00, run_end_date=2024-07-04 03:32:38.388119+00:00, run_duration=0.361895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:32:37.253151+00:00, queued_by_job_id=2, pid=9978 2024-07-04T03:33:00.436090905Z [2024-07-04T03:33:00.435+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:33:00.477930692Z [2024-07-04T03:33:00.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:33:00+00:00, run_after=2024-07-04T03:34:00+00:00 2024-07-04T03:33:00.691673380Z [2024-07-04T03:33:00.691+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:33:00.691703682Z 2024-07-04T03:33:00.691707629Z 2024-07-04T03:33:00.691718459Z [2024-07-04T03:33:00.691+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:33:00.691779121Z [2024-07-04T03:33:00.691+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:33:00.692435050Z [2024-07-04T03:33:00.692+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:33:00.692447522Z 2024-07-04T03:33:00.692451235Z 2024-07-04T03:33:00.698370257Z [2024-07-04T03:33:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:33:00.698389065Z [2024-07-04T03:33:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:33:00.698397454Z [2024-07-04T03:33:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:33:00.698400988Z [2024-07-04T03:33:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:33:00.983789429Z [2024-07-04T03:33:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:32:00+00:00 exited with status queued for try_number 1 2024-07-04T03:33:00.983836822Z [2024-07-04T03:33:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:32:00+00:00 exited with status queued for try_number 1 2024-07-04T03:33:00.994148541Z [2024-07-04T03:33:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a2d89f7-79d9-4df0-9988-36195e0fa754 2024-07-04T03:33:00.994184812Z [2024-07-04T03:33:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b8860bc-861b-4f89-9df8-354acaff9105 2024-07-04T03:33:04.980688179Z [2024-07-04T03:33:04.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:33:04.981132647Z [2024-07-04T03:33:04.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:32:00+00:00, run_id=scheduled__2024-07-04T03:32:00+00:00, run_start_date=2024-07-04 03:33:00.531704+00:00, run_end_date=2024-07-04 03:33:04.980453+00:00, run_duration=4.448749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:32:00+00:00, data_interval_end=2024-07-04 03:33:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:33:04.994706503Z [2024-07-04T03:33:04.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:33:00+00:00, run_after=2024-07-04T03:34:00+00:00 2024-07-04T03:33:05.005479485Z [2024-07-04T03:33:05.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:33:05.005772112Z [2024-07-04T03:33:05.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:32:00+00:00, run_id=scheduled__2024-07-04T03:32:00+00:00, run_start_date=2024-07-04 03:33:00.540024+00:00, run_end_date=2024-07-04 03:33:05.005298+00:00, run_duration=4.465274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:32:00+00:00, data_interval_end=2024-07-04 03:33:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:33:05.020103942Z [2024-07-04T03:33:05.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:33:00+00:00, run_after=2024-07-04T03:34:00+00:00 2024-07-04T03:33:05.076986585Z [2024-07-04T03:33:05.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:32:00+00:00 exited with status success for try_number 1 2024-07-04T03:33:05.077457331Z [2024-07-04T03:33:05.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:32:00+00:00 exited with status success for try_number 1 2024-07-04T03:33:05.090716465Z [2024-07-04T03:33:05.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:32:00+00:00, map_index=-1, run_start_date=2024-07-04 03:33:02.876018+00:00, run_end_date=2024-07-04 03:33:04.506736+00:00, run_duration=1.630718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:33:00.693083+00:00, queued_by_job_id=2, pid=10023 2024-07-04T03:33:05.091228444Z [2024-07-04T03:33:05.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:32:00+00:00, map_index=-1, run_start_date=2024-07-04 03:33:02.758776+00:00, run_end_date=2024-07-04 03:33:04.130704+00:00, run_duration=1.371928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:33:00.693083+00:00, queued_by_job_id=2, pid=10022 2024-07-04T03:34:00.288373939Z [2024-07-04T03:34:00.287+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:34:00.306233825Z [2024-07-04T03:34:00.305+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:34:00.330661493Z [2024-07-04T03:34:00.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:34:00+00:00, run_after=2024-07-04T03:35:00+00:00 2024-07-04T03:34:00.412464665Z [2024-07-04T03:34:00.412+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:34:00.412489896Z 2024-07-04T03:34:00.412514794Z 2024-07-04T03:34:00.412518550Z 2024-07-04T03:34:00.412860331Z [2024-07-04T03:34:00.412+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:34:00.413118382Z [2024-07-04T03:34:00.412+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:34:00.413262897Z [2024-07-04T03:34:00.413+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:34:00.413901308Z [2024-07-04T03:34:00.413+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:34:00.413911980Z 2024-07-04T03:34:00.413916402Z 2024-07-04T03:34:00.413920237Z 2024-07-04T03:34:00.417556117Z [2024-07-04T03:34:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:34:00.417945902Z [2024-07-04T03:34:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:34:00.418358824Z [2024-07-04T03:34:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:34:00.418644336Z [2024-07-04T03:34:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:34:00.419058321Z [2024-07-04T03:34:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:34:00.419243257Z [2024-07-04T03:34:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:34:00.712703305Z [2024-07-04T03:34:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:32:00+00:00 exited with status queued for try_number 1 2024-07-04T03:34:00.715084664Z [2024-07-04T03:34:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:33:00+00:00 exited with status queued for try_number 1 2024-07-04T03:34:00.715284946Z [2024-07-04T03:34:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:33:00+00:00 exited with status queued for try_number 1 2024-07-04T03:34:00.723099768Z [2024-07-04T03:34:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79d392e0-a70d-49a0-bdbe-4e3b25ad45e2 2024-07-04T03:34:00.723312639Z [2024-07-04T03:34:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5ff2af3-039d-48ac-b7e1-d2fecee779e6 2024-07-04T03:34:00.723513472Z [2024-07-04T03:34:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83f58a84-eca8-44d7-ad89-6a989770c2b8 2024-07-04T03:34:03.103264173Z [2024-07-04T03:34:03.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:34:03.103623281Z [2024-07-04T03:34:03.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:32:00+00:00, run_id=scheduled__2024-07-04T03:32:00+00:00, run_start_date=2024-07-04 03:34:00.346521+00:00, run_end_date=2024-07-04 03:34:03.102971+00:00, run_duration=2.75645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:32:00+00:00, data_interval_end=2024-07-04 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:34:03.112928339Z [2024-07-04T03:34:03.112+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:34:00+00:00, run_after=2024-07-04T03:36:00+00:00 2024-07-04T03:34:03.171457389Z [2024-07-04T03:34:03.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:32:00+00:00 exited with status success for try_number 1 2024-07-04T03:34:03.182476536Z [2024-07-04T03:34:03.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:32:00+00:00, map_index=-1, run_start_date=2024-07-04 03:34:01.467739+00:00, run_end_date=2024-07-04 03:34:01.919135+00:00, run_duration=0.451396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:34:00.414646+00:00, queued_by_job_id=2, pid=10059 2024-07-04T03:34:04.241471661Z [2024-07-04T03:34:04.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:34:04.244007710Z [2024-07-04T03:34:04.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:33:00+00:00, run_id=scheduled__2024-07-04T03:33:00+00:00, run_start_date=2024-07-04 03:34:00.349799+00:00, run_end_date=2024-07-04 03:34:04.241416+00:00, run_duration=3.891617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:33:00+00:00, data_interval_end=2024-07-04 03:34:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:34:04.257000923Z [2024-07-04T03:34:04.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:34:00+00:00, run_after=2024-07-04T03:35:00+00:00 2024-07-04T03:34:04.300265278Z [2024-07-04T03:34:04.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:33:00+00:00 exited with status success for try_number 1 2024-07-04T03:34:04.306513990Z [2024-07-04T03:34:04.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:33:00+00:00, map_index=-1, run_start_date=2024-07-04 03:34:02.347055+00:00, run_end_date=2024-07-04 03:34:04.121907+00:00, run_duration=1.774852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:34:00.414646+00:00, queued_by_job_id=2, pid=10088 2024-07-04T03:34:05.359975822Z [2024-07-04T03:34:05.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:34:05.360192991Z [2024-07-04T03:34:05.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:33:00+00:00, run_id=scheduled__2024-07-04T03:33:00+00:00, run_start_date=2024-07-04 03:34:00.348279+00:00, run_end_date=2024-07-04 03:34:05.359733+00:00, run_duration=5.011454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:33:00+00:00, data_interval_end=2024-07-04 03:34:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:34:05.369339494Z [2024-07-04T03:34:05.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:34:00+00:00, run_after=2024-07-04T03:35:00+00:00 2024-07-04T03:34:05.426987674Z [2024-07-04T03:34:05.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:33:00+00:00 exited with status success for try_number 1 2024-07-04T03:34:05.437713704Z [2024-07-04T03:34:05.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:33:00+00:00, map_index=-1, run_start_date=2024-07-04 03:34:02.542592+00:00, run_end_date=2024-07-04 03:34:04.266863+00:00, run_duration=1.724271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:34:00.414646+00:00, queued_by_job_id=2, pid=10089 2024-07-04T03:34:36.654196100Z [2024-07-04T03:34:36.653+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:34:36.654237461Z 2024-07-04T03:34:36.655798445Z [2024-07-04T03:34:36.654+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-07-04T03:34:36.657802456Z [2024-07-04T03:34:36.657+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:34:36.657815142Z 2024-07-04T03:34:36.664269904Z [2024-07-04T03:34:36.663+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240704033436_543838', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:34:36.664536599Z [2024-07-04T03:34:36.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240704033436_543838', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-07-04T03:34:36.779206433Z [2024-07-04T03:34:36.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240704033436_543838 exited with status queued for try_number 1 2024-07-04T03:34:36.791776895Z [2024-07-04T03:34:36.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4b01509-fdfb-44d4-99cf-fd63656e027c 2024-07-04T03:34:38.682973576Z [2024-07-04T03:34:38.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:34:38.683011419Z [2024-07-04T03:34:38.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-07-04 03:34:36.508884+00:00, run_id=scaleout_vdu_20240704033436_543838, run_start_date=2024-07-04 03:34:36.622175+00:00, run_end_date=2024-07-04 03:34:38.681294+00:00, run_duration=2.059119, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-07-04 03:34:36.508884+00:00, data_interval_end=2024-07-04 03:34:36.508884+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-07-04T03:34:38.686080427Z [2024-07-04T03:34:38.685+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-07-04T03:34:38.733623226Z [2024-07-04T03:34:38.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240704033436_543838 exited with status success for try_number 1 2024-07-04T03:34:38.748596178Z [2024-07-04T03:34:38.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240704033436_543838, map_index=-1, run_start_date=2024-07-04 03:34:37.521873+00:00, run_end_date=2024-07-04 03:34:37.989347+00:00, run_duration=0.467474, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:34:36.658613+00:00, queued_by_job_id=2, pid=10109 2024-07-04T03:35:00.553251560Z [2024-07-04T03:35:00.552+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:35:00.571573348Z [2024-07-04T03:35:00.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:35:00+00:00, run_after=2024-07-04T03:40:00+00:00 2024-07-04T03:35:00.588244694Z [2024-07-04T03:35:00.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:35:00+00:00, run_after=2024-07-04T03:36:00+00:00 2024-07-04T03:35:00.706482013Z [2024-07-04T03:35:00.706+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:35:00.706505141Z 2024-07-04T03:35:00.706512066Z 2024-07-04T03:35:00.706515405Z 2024-07-04T03:35:00.706689211Z [2024-07-04T03:35:00.706+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:35:00.706926963Z [2024-07-04T03:35:00.706+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:35:00.707117987Z [2024-07-04T03:35:00.706+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:35:00.707807757Z [2024-07-04T03:35:00.707+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:35:00.707821268Z 2024-07-04T03:35:00.707825078Z 2024-07-04T03:35:00.707828356Z 2024-07-04T03:35:00.711799977Z [2024-07-04T03:35:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:35:00.712041185Z [2024-07-04T03:35:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:35:00.712344514Z [2024-07-04T03:35:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:35:00.712912426Z [2024-07-04T03:35:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:35:00.713289466Z [2024-07-04T03:35:00.713+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:35:00.713444763Z [2024-07-04T03:35:00.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:35:01.254995182Z [2024-07-04T03:35:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status queued for try_number 1 2024-07-04T03:35:01.255400820Z [2024-07-04T03:35:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:34:00+00:00 exited with status queued for try_number 1 2024-07-04T03:35:01.255730512Z [2024-07-04T03:35:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:34:00+00:00 exited with status queued for try_number 1 2024-07-04T03:35:01.277098554Z [2024-07-04T03:35:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 466c7cde-3ab2-427a-957d-9c303d5bee21 2024-07-04T03:35:01.277539991Z [2024-07-04T03:35:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ed6c4f0-8df1-4720-a824-12a9538bb95e 2024-07-04T03:35:01.278572303Z [2024-07-04T03:35:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0e99e74-6ed8-40ab-b72b-4ba2bce72c35 2024-07-04T03:35:04.158042334Z [2024-07-04T03:35:04.157+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:35:04.158098455Z 2024-07-04T03:35:04.158273548Z [2024-07-04T03:35:04.157+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:35:04.159248038Z [2024-07-04T03:35:04.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:35:04.159274064Z 2024-07-04T03:35:04.162525456Z [2024-07-04T03:35:04.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:35:04.162699811Z [2024-07-04T03:35:04.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:35:04.229399618Z [2024-07-04T03:35:04.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status queued for try_number 1 2024-07-04T03:35:04.229638899Z [2024-07-04T03:35:04.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status success for try_number 1 2024-07-04T03:35:04.241326426Z [2024-07-04T03:35:04.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ba80a29-1112-43f2-8b27-59a363ff3fe7 2024-07-04T03:35:04.241940084Z [2024-07-04T03:35:04.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:30:00+00:00, map_index=-1, run_start_date=2024-07-04 03:35:03.177313+00:00, run_end_date=2024-07-04 03:35:03.605453+00:00, run_duration=0.42814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:35:00.708719+00:00, queued_by_job_id=2, pid=10176 2024-07-04T03:35:04.741985770Z [2024-07-04T03:35:04.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:35:04.742023940Z [2024-07-04T03:35:04.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:34:00+00:00, run_id=scheduled__2024-07-04T03:34:00+00:00, run_start_date=2024-07-04 03:35:00.611090+00:00, run_end_date=2024-07-04 03:35:04.741035+00:00, run_duration=4.129945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:34:00+00:00, data_interval_end=2024-07-04 03:35:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:35:04.750594289Z [2024-07-04T03:35:04.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:35:00+00:00, run_after=2024-07-04T03:36:00+00:00 2024-07-04T03:35:04.770166284Z [2024-07-04T03:35:04.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:35:04.770319401Z [2024-07-04T03:35:04.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:34:00+00:00, run_id=scheduled__2024-07-04T03:34:00+00:00, run_start_date=2024-07-04 03:35:00.613255+00:00, run_end_date=2024-07-04 03:35:04.770054+00:00, run_duration=4.156799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:34:00+00:00, data_interval_end=2024-07-04 03:35:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:35:04.780284743Z [2024-07-04T03:35:04.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:35:00+00:00, run_after=2024-07-04T03:36:00+00:00 2024-07-04T03:35:04.838649997Z [2024-07-04T03:35:04.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:34:00+00:00 exited with status success for try_number 1 2024-07-04T03:35:04.838745256Z [2024-07-04T03:35:04.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:34:00+00:00 exited with status success for try_number 1 2024-07-04T03:35:04.846827999Z [2024-07-04T03:35:04.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:34:00+00:00, map_index=-1, run_start_date=2024-07-04 03:35:03.025112+00:00, run_end_date=2024-07-04 03:35:04.377084+00:00, run_duration=1.351972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:35:00.708719+00:00, queued_by_job_id=2, pid=10166 2024-07-04T03:35:04.846936886Z [2024-07-04T03:35:04.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:34:00+00:00, map_index=-1, run_start_date=2024-07-04 03:35:02.852559+00:00, run_end_date=2024-07-04 03:35:04.430966+00:00, run_duration=1.578407, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:35:00.708719+00:00, queued_by_job_id=2, pid=10156 2024-07-04T03:35:07.048644130Z [2024-07-04T03:35:07.047+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:35:07.048696075Z 2024-07-04T03:35:07.049186468Z [2024-07-04T03:35:07.048+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:35:07.050744239Z [2024-07-04T03:35:07.050+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:35:07.050758652Z 2024-07-04T03:35:07.056022689Z [2024-07-04T03:35:07.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:35:07.056534098Z [2024-07-04T03:35:07.056+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:35:07.116759206Z [2024-07-04T03:35:07.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status queued for try_number 1 2024-07-04T03:35:07.116976801Z [2024-07-04T03:35:07.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status success for try_number 1 2024-07-04T03:35:07.124753910Z [2024-07-04T03:35:07.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef87e8ff-2c94-452d-a3e9-190e5f46e306 2024-07-04T03:35:07.125156655Z [2024-07-04T03:35:07.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:30:00+00:00, map_index=-1, run_start_date=2024-07-04 03:35:05.906824+00:00, run_end_date=2024-07-04 03:35:06.323443+00:00, run_duration=0.416619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:35:04.159742+00:00, queued_by_job_id=2, pid=10206 2024-07-04T03:35:10.343186753Z [2024-07-04T03:35:10.342+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:35:10.343217793Z 2024-07-04T03:35:10.343281192Z [2024-07-04T03:35:10.343+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:35:10.343822627Z [2024-07-04T03:35:10.343+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:35:10.343833874Z 2024-07-04T03:35:10.348263129Z [2024-07-04T03:35:10.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:35:10.348683498Z [2024-07-04T03:35:10.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:35:10.494559218Z [2024-07-04T03:35:10.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status queued for try_number 1 2024-07-04T03:35:10.494593260Z [2024-07-04T03:35:10.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status success for try_number 1 2024-07-04T03:35:10.504245526Z [2024-07-04T03:35:10.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bcde89a-e4ab-4744-9d8c-5841b4f18b4f 2024-07-04T03:35:10.504296411Z [2024-07-04T03:35:10.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:30:00+00:00, map_index=0, run_start_date=2024-07-04 03:35:08.762662+00:00, run_end_date=2024-07-04 03:35:10.009460+00:00, run_duration=1.246798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:35:07.052121+00:00, queued_by_job_id=2, pid=10218 2024-07-04T03:35:12.731531231Z [2024-07-04T03:35:12.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:35:12.731992019Z [2024-07-04T03:35:12.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:30:00+00:00, run_id=scheduled__2024-07-04T03:30:00+00:00, run_start_date=2024-07-04 03:35:00.605404+00:00, run_end_date=2024-07-04 03:35:12.731418+00:00, run_duration=12.126014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:30:00+00:00, data_interval_end=2024-07-04 03:35:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:35:12.738652366Z [2024-07-04T03:35:12.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:35:00+00:00, run_after=2024-07-04T03:40:00+00:00 2024-07-04T03:35:12.769984975Z [2024-07-04T03:35:12.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:30:00+00:00 exited with status success for try_number 1 2024-07-04T03:35:12.776091336Z [2024-07-04T03:35:12.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:30:00+00:00, map_index=-1, run_start_date=2024-07-04 03:35:12.104468+00:00, run_end_date=2024-07-04 03:35:12.538103+00:00, run_duration=0.433635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:35:10.344239+00:00, queued_by_job_id=2, pid=10238 2024-07-04T03:36:00.818173641Z [2024-07-04T03:36:00.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:36:00+00:00, run_after=2024-07-04T03:37:00+00:00 2024-07-04T03:36:00.828895920Z [2024-07-04T03:36:00.828+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:36:00.837656939Z [2024-07-04T03:36:00.837+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:36:00.976183309Z [2024-07-04T03:36:00.975+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:36:00.976204183Z 2024-07-04T03:36:00.976208932Z 2024-07-04T03:36:00.976212337Z 2024-07-04T03:36:00.977867823Z [2024-07-04T03:36:00.976+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:36:00.978099767Z [2024-07-04T03:36:00.977+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:36:00.978232073Z [2024-07-04T03:36:00.978+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:36:00.979953895Z [2024-07-04T03:36:00.979+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:36:00.979973640Z 2024-07-04T03:36:00.979979200Z 2024-07-04T03:36:00.979983416Z 2024-07-04T03:36:00.989003699Z [2024-07-04T03:36:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:36:00.989134439Z [2024-07-04T03:36:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:36:00.989385483Z [2024-07-04T03:36:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:36:00.989513475Z [2024-07-04T03:36:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:36:00.989711007Z [2024-07-04T03:36:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:36:00.989787280Z [2024-07-04T03:36:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:36:01.280372361Z [2024-07-04T03:36:01.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:34:00+00:00 exited with status queued for try_number 1 2024-07-04T03:36:01.280687949Z [2024-07-04T03:36:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status queued for try_number 1 2024-07-04T03:36:01.280878454Z [2024-07-04T03:36:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status queued for try_number 1 2024-07-04T03:36:01.295904759Z [2024-07-04T03:36:01.295+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0a20040-0631-4b10-bd08-b423decf01c0 2024-07-04T03:36:01.296446471Z [2024-07-04T03:36:01.295+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f0e049f-6be4-4092-a8da-cfcdeac9da64 2024-07-04T03:36:01.296774347Z [2024-07-04T03:36:01.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab073146-a035-4308-8680-92ef4225be4b 2024-07-04T03:36:02.466134843Z [2024-07-04T03:36:02.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:36:02.466452297Z [2024-07-04T03:36:02.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:34:00+00:00, run_id=scheduled__2024-07-04T03:34:00+00:00, run_start_date=2024-07-04 03:36:00.857682+00:00, run_end_date=2024-07-04 03:36:02.466090+00:00, run_duration=1.608408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:34:00+00:00, data_interval_end=2024-07-04 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:36:02.475014117Z [2024-07-04T03:36:02.474+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:36:00+00:00, run_after=2024-07-04T03:38:00+00:00 2024-07-04T03:36:02.528639496Z [2024-07-04T03:36:02.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:34:00+00:00 exited with status success for try_number 1 2024-07-04T03:36:02.535694054Z [2024-07-04T03:36:02.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:34:00+00:00, map_index=-1, run_start_date=2024-07-04 03:36:01.819742+00:00, run_end_date=2024-07-04 03:36:02.204202+00:00, run_duration=0.38446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:36:00.983773+00:00, queued_by_job_id=2, pid=10255 2024-07-04T03:36:05.137457492Z [2024-07-04T03:36:05.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:36:05.138121046Z [2024-07-04T03:36:05.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:35:00+00:00, run_id=scheduled__2024-07-04T03:35:00+00:00, run_start_date=2024-07-04 03:36:00.859435+00:00, run_end_date=2024-07-04 03:36:05.137201+00:00, run_duration=4.277766, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:35:00+00:00, data_interval_end=2024-07-04 03:36:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:36:05.150751579Z [2024-07-04T03:36:05.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:36:00+00:00, run_after=2024-07-04T03:37:00+00:00 2024-07-04T03:36:05.158340367Z [2024-07-04T03:36:05.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:36:05.158699673Z [2024-07-04T03:36:05.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:35:00+00:00, run_id=scheduled__2024-07-04T03:35:00+00:00, run_start_date=2024-07-04 03:36:00.860804+00:00, run_end_date=2024-07-04 03:36:05.158069+00:00, run_duration=4.297265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:35:00+00:00, data_interval_end=2024-07-04 03:36:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:36:05.168179402Z [2024-07-04T03:36:05.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:36:00+00:00, run_after=2024-07-04T03:37:00+00:00 2024-07-04T03:36:05.209118586Z [2024-07-04T03:36:05.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status success for try_number 1 2024-07-04T03:36:05.209158794Z [2024-07-04T03:36:05.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status success for try_number 1 2024-07-04T03:36:05.217682025Z [2024-07-04T03:36:05.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:35:00+00:00, map_index=-1, run_start_date=2024-07-04 03:36:02.974942+00:00, run_end_date=2024-07-04 03:36:04.344480+00:00, run_duration=1.369538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:36:00.983773+00:00, queued_by_job_id=2, pid=10285 2024-07-04T03:36:05.218109759Z [2024-07-04T03:36:05.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:35:00+00:00, map_index=-1, run_start_date=2024-07-04 03:36:02.954667+00:00, run_end_date=2024-07-04 03:36:04.759585+00:00, run_duration=1.804918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:36:00.983773+00:00, queued_by_job_id=2, pid=10284 2024-07-04T03:36:22.752283142Z [2024-07-04T03:36:22.751+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:36:29.532000454Z [2024-07-04T03:36:29.531+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:36:29.532052464Z 2024-07-04T03:36:29.532386004Z [2024-07-04T03:36:29.532+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-07-04T03:36:29.532970190Z [2024-07-04T03:36:29.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:36:29.532985618Z 2024-07-04T03:36:29.535307689Z [2024-07-04T03:36:29.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240704033628_330906', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:36:29.535453772Z [2024-07-04T03:36:29.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240704033628_330906', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-07-04T03:36:29.616445228Z [2024-07-04T03:36:29.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240704033628_330906 exited with status queued for try_number 1 2024-07-04T03:36:29.636284192Z [2024-07-04T03:36:29.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12365642-ca96-47b8-bbbf-dc72dac83da6 2024-07-04T03:36:31.019792374Z [2024-07-04T03:36:31.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:36:31.020390448Z [2024-07-04T03:36:31.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-07-04 03:36:28.806309+00:00, run_id=vdu_alarm_20240704033628_330906, run_start_date=2024-07-04 03:36:29.504893+00:00, run_end_date=2024-07-04 03:36:31.019832+00:00, run_duration=1.514939, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-07-04 03:36:28.806309+00:00, data_interval_end=2024-07-04 03:36:28.806309+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-07-04T03:36:31.026266526Z [2024-07-04T03:36:31.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-07-04T03:36:31.065488301Z [2024-07-04T03:36:31.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240704033628_330906 exited with status success for try_number 1 2024-07-04T03:36:31.075538210Z [2024-07-04T03:36:31.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240704033628_330906, map_index=-1, run_start_date=2024-07-04 03:36:30.223115+00:00, run_end_date=2024-07-04 03:36:30.685602+00:00, run_duration=0.462487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:36:29.533368+00:00, queued_by_job_id=2, pid=10305 2024-07-04T03:37:00.061135206Z [2024-07-04T03:37:00.060+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:37:00.082917645Z [2024-07-04T03:37:00.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:37:00+00:00, run_after=2024-07-04T03:38:00+00:00 2024-07-04T03:37:00.147738527Z [2024-07-04T03:37:00.147+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:37:00.147770359Z 2024-07-04T03:37:00.147774229Z 2024-07-04T03:37:00.147980809Z [2024-07-04T03:37:00.147+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:37:00.148106144Z [2024-07-04T03:37:00.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:37:00.148646064Z [2024-07-04T03:37:00.148+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:37:00.148652060Z 2024-07-04T03:37:00.148655603Z 2024-07-04T03:37:00.152407752Z [2024-07-04T03:37:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:37:00.152543686Z [2024-07-04T03:37:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:37:00.152828806Z [2024-07-04T03:37:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:37:00.152919956Z [2024-07-04T03:37:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:37:00.452053007Z [2024-07-04T03:37:00.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:36:00+00:00 exited with status queued for try_number 1 2024-07-04T03:37:00.452109677Z [2024-07-04T03:37:00.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:36:00+00:00 exited with status queued for try_number 1 2024-07-04T03:37:00.460420454Z [2024-07-04T03:37:00.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ec957b4-0f40-4d5b-b04f-2cae5ce0c4d7 2024-07-04T03:37:00.460455018Z [2024-07-04T03:37:00.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f3d2d6e-1e94-41c9-be27-47b03bdfd243 2024-07-04T03:37:04.961102415Z [2024-07-04T03:37:04.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:37:04.962076249Z [2024-07-04T03:37:04.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:36:00+00:00, run_id=scheduled__2024-07-04T03:36:00+00:00, run_start_date=2024-07-04 03:37:00.094481+00:00, run_end_date=2024-07-04 03:37:04.960978+00:00, run_duration=4.866497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:36:00+00:00, data_interval_end=2024-07-04 03:37:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:37:04.973026102Z [2024-07-04T03:37:04.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:37:00+00:00, run_after=2024-07-04T03:38:00+00:00 2024-07-04T03:37:04.980720189Z [2024-07-04T03:37:04.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:37:04.981127460Z [2024-07-04T03:37:04.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:36:00+00:00, run_id=scheduled__2024-07-04T03:36:00+00:00, run_start_date=2024-07-04 03:37:00.095920+00:00, run_end_date=2024-07-04 03:37:04.980582+00:00, run_duration=4.884662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:36:00+00:00, data_interval_end=2024-07-04 03:37:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:37:04.990836036Z [2024-07-04T03:37:04.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:37:00+00:00, run_after=2024-07-04T03:38:00+00:00 2024-07-04T03:37:05.030406551Z [2024-07-04T03:37:05.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:36:00+00:00 exited with status success for try_number 1 2024-07-04T03:37:05.030709733Z [2024-07-04T03:37:05.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:36:00+00:00 exited with status success for try_number 1 2024-07-04T03:37:05.039196340Z [2024-07-04T03:37:05.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:36:00+00:00, map_index=-1, run_start_date=2024-07-04 03:37:02.477228+00:00, run_end_date=2024-07-04 03:37:03.888040+00:00, run_duration=1.410812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:37:00.149366+00:00, queued_by_job_id=2, pid=10350 2024-07-04T03:37:05.039682338Z [2024-07-04T03:37:05.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:36:00+00:00, map_index=-1, run_start_date=2024-07-04 03:37:02.582500+00:00, run_end_date=2024-07-04 03:37:04.503411+00:00, run_duration=1.920911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:37:00.149366+00:00, queued_by_job_id=2, pid=10351 2024-07-04T03:38:00.646107558Z [2024-07-04T03:38:00.645+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:38:00.663318447Z [2024-07-04T03:38:00.662+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:38:00.682323749Z [2024-07-04T03:38:00.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:38:00+00:00, run_after=2024-07-04T03:39:00+00:00 2024-07-04T03:38:00.814380086Z [2024-07-04T03:38:00.813+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:38:00.814398713Z 2024-07-04T03:38:00.814414963Z 2024-07-04T03:38:00.814418491Z 2024-07-04T03:38:00.814617919Z [2024-07-04T03:38:00.814+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:38:00.814880579Z [2024-07-04T03:38:00.814+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:38:00.815075429Z [2024-07-04T03:38:00.814+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:38:00.815793323Z [2024-07-04T03:38:00.815+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:38:00.815804611Z 2024-07-04T03:38:00.815808466Z 2024-07-04T03:38:00.815812080Z 2024-07-04T03:38:00.822959179Z [2024-07-04T03:38:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:38:00.823310430Z [2024-07-04T03:38:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:38:00.823672631Z [2024-07-04T03:38:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:38:00.823846610Z [2024-07-04T03:38:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:38:00.824200200Z [2024-07-04T03:38:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:38:00.824403805Z [2024-07-04T03:38:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:38:01.283396778Z [2024-07-04T03:38:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:36:00+00:00 exited with status queued for try_number 1 2024-07-04T03:38:01.283493890Z [2024-07-04T03:38:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:37:00+00:00 exited with status queued for try_number 1 2024-07-04T03:38:01.283899409Z [2024-07-04T03:38:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:37:00+00:00 exited with status queued for try_number 1 2024-07-04T03:38:01.298162171Z [2024-07-04T03:38:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8141d2a0-5f60-4be3-aa4e-84298ca49094 2024-07-04T03:38:01.298358358Z [2024-07-04T03:38:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d4c5338-f48f-4862-bfe0-bd809fea6c56 2024-07-04T03:38:01.298530416Z [2024-07-04T03:38:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08f75ca1-431d-47e2-9820-0261fa02bc74 2024-07-04T03:38:03.817937206Z [2024-07-04T03:38:03.817+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:38:03.818578421Z [2024-07-04T03:38:03.818+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:36:00+00:00, run_id=scheduled__2024-07-04T03:36:00+00:00, run_start_date=2024-07-04 03:38:00.722393+00:00, run_end_date=2024-07-04 03:38:03.817791+00:00, run_duration=3.095398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:36:00+00:00, data_interval_end=2024-07-04 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:38:03.833440046Z [2024-07-04T03:38:03.832+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:38:00+00:00, run_after=2024-07-04T03:40:00+00:00 2024-07-04T03:38:03.935036265Z [2024-07-04T03:38:03.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:36:00+00:00 exited with status success for try_number 1 2024-07-04T03:38:03.940007618Z [2024-07-04T03:38:03.939+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:36:00+00:00, map_index=-1, run_start_date=2024-07-04 03:38:02.189865+00:00, run_end_date=2024-07-04 03:38:02.789482+00:00, run_duration=0.599617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:38:00.817400+00:00, queued_by_job_id=2, pid=10387 2024-07-04T03:38:06.060265349Z [2024-07-04T03:38:06.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:38:06.060621355Z [2024-07-04T03:38:06.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:37:00+00:00, run_id=scheduled__2024-07-04T03:37:00+00:00, run_start_date=2024-07-04 03:38:00.727209+00:00, run_end_date=2024-07-04 03:38:06.060055+00:00, run_duration=5.332846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:37:00+00:00, data_interval_end=2024-07-04 03:38:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:38:06.077900099Z [2024-07-04T03:38:06.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:38:00+00:00, run_after=2024-07-04T03:39:00+00:00 2024-07-04T03:38:06.091771256Z [2024-07-04T03:38:06.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:38:06.092395168Z [2024-07-04T03:38:06.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:37:00+00:00, run_id=scheduled__2024-07-04T03:37:00+00:00, run_start_date=2024-07-04 03:38:00.728925+00:00, run_end_date=2024-07-04 03:38:06.091625+00:00, run_duration=5.3627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:37:00+00:00, data_interval_end=2024-07-04 03:38:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:38:06.112053012Z [2024-07-04T03:38:06.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:38:00+00:00, run_after=2024-07-04T03:39:00+00:00 2024-07-04T03:38:06.166040334Z [2024-07-04T03:38:06.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:37:00+00:00 exited with status success for try_number 1 2024-07-04T03:38:06.166153870Z [2024-07-04T03:38:06.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:37:00+00:00 exited with status success for try_number 1 2024-07-04T03:38:06.178062573Z [2024-07-04T03:38:06.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:37:00+00:00, map_index=-1, run_start_date=2024-07-04 03:38:03.591270+00:00, run_end_date=2024-07-04 03:38:05.303554+00:00, run_duration=1.712284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:38:00.817400+00:00, queued_by_job_id=2, pid=10418 2024-07-04T03:38:06.178626551Z [2024-07-04T03:38:06.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:37:00+00:00, map_index=-1, run_start_date=2024-07-04 03:38:03.384767+00:00, run_end_date=2024-07-04 03:38:05.464120+00:00, run_duration=2.079353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:38:00.817400+00:00, queued_by_job_id=2, pid=10417 2024-07-04T03:39:00.648634334Z [2024-07-04T03:39:00.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:39:00+00:00, run_after=2024-07-04T03:40:00+00:00 2024-07-04T03:39:00.659914613Z [2024-07-04T03:39:00.659+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:39:00.720688897Z [2024-07-04T03:39:00.720+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:39:00.720718129Z 2024-07-04T03:39:00.720726539Z 2024-07-04T03:39:00.720870094Z [2024-07-04T03:39:00.720+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:39:00.721062971Z [2024-07-04T03:39:00.720+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:39:00.721766281Z [2024-07-04T03:39:00.721+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:39:00.721779974Z 2024-07-04T03:39:00.721783483Z 2024-07-04T03:39:00.725043962Z [2024-07-04T03:39:00.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:39:00.725320699Z [2024-07-04T03:39:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:39:00.725643550Z [2024-07-04T03:39:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:39:00.725832010Z [2024-07-04T03:39:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:39:01.038336328Z [2024-07-04T03:39:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:38:00+00:00 exited with status queued for try_number 1 2024-07-04T03:39:01.038533590Z [2024-07-04T03:39:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:38:00+00:00 exited with status queued for try_number 1 2024-07-04T03:39:01.050501499Z [2024-07-04T03:39:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to 378b15a1-3647-479b-a250-24baa1f1ca97 2024-07-04T03:39:01.050815762Z [2024-07-04T03:39:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46a52a68-ee94-419d-80fd-ce1afb0cd8e8 2024-07-04T03:39:04.741441109Z [2024-07-04T03:39:04.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:39:04.741505032Z [2024-07-04T03:39:04.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:38:00+00:00, run_id=scheduled__2024-07-04T03:38:00+00:00, run_start_date=2024-07-04 03:39:00.675444+00:00, run_end_date=2024-07-04 03:39:04.733354+00:00, run_duration=4.05791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:38:00+00:00, data_interval_end=2024-07-04 03:39:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:39:04.747075863Z [2024-07-04T03:39:04.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:39:00+00:00, run_after=2024-07-04T03:40:00+00:00 2024-07-04T03:39:04.755388055Z [2024-07-04T03:39:04.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:39:04.755439351Z [2024-07-04T03:39:04.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:38:00+00:00, run_id=scheduled__2024-07-04T03:38:00+00:00, run_start_date=2024-07-04 03:39:00.680352+00:00, run_end_date=2024-07-04 03:39:04.753975+00:00, run_duration=4.073623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:38:00+00:00, data_interval_end=2024-07-04 03:39:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:39:04.763104348Z [2024-07-04T03:39:04.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:39:00+00:00, run_after=2024-07-04T03:40:00+00:00 2024-07-04T03:39:04.811059872Z [2024-07-04T03:39:04.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:38:00+00:00 exited with status success for try_number 1 2024-07-04T03:39:04.811088981Z [2024-07-04T03:39:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:38:00+00:00 exited with status success for try_number 1 2024-07-04T03:39:04.820312835Z [2024-07-04T03:39:04.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:38:00+00:00, map_index=-1, run_start_date=2024-07-04 03:39:02.606210+00:00, run_end_date=2024-07-04 03:39:04.407091+00:00, run_duration=1.800881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:39:00.722394+00:00, queued_by_job_id=2, pid=10474 2024-07-04T03:39:04.820497964Z [2024-07-04T03:39:04.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:38:00+00:00, map_index=-1, run_start_date=2024-07-04 03:39:02.570018+00:00, run_end_date=2024-07-04 03:39:04.039518+00:00, run_duration=1.4695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:39:00.722394+00:00, queued_by_job_id=2, pid=10473 2024-07-04T03:40:00.579912037Z [2024-07-04T03:40:00.577+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:40:00.594678421Z [2024-07-04T03:40:00.594+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:40:00.615488847Z [2024-07-04T03:40:00.615+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:40:00+00:00, run_after=2024-07-04T03:41:00+00:00 2024-07-04T03:40:00.644932477Z [2024-07-04T03:40:00.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:40:00+00:00, run_after=2024-07-04T03:45:00+00:00 2024-07-04T03:40:00.740771492Z [2024-07-04T03:40:00.740+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T03:40:00.740805807Z 2024-07-04T03:40:00.740811278Z 2024-07-04T03:40:00.740817933Z 2024-07-04T03:40:00.740823071Z 2024-07-04T03:40:00.740881022Z [2024-07-04T03:40:00.740+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:40:00.741029909Z [2024-07-04T03:40:00.740+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:40:00.741182751Z [2024-07-04T03:40:00.741+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:40:00.741289463Z [2024-07-04T03:40:00.741+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:40:00.742001034Z [2024-07-04T03:40:00.741+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:40:00.742018729Z 2024-07-04T03:40:00.742025211Z 2024-07-04T03:40:00.742030539Z 2024-07-04T03:40:00.742035020Z 2024-07-04T03:40:00.746475751Z [2024-07-04T03:40:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:40:00.746698777Z [2024-07-04T03:40:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:40:00.747048004Z [2024-07-04T03:40:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:40:00.747216530Z [2024-07-04T03:40:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:40:00.747488386Z [2024-07-04T03:40:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:40:00.747868689Z [2024-07-04T03:40:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:40:00.748179585Z [2024-07-04T03:40:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:40:00.748326524Z [2024-07-04T03:40:00.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:40:01.339695651Z [2024-07-04T03:40:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status queued for try_number 1 2024-07-04T03:40:01.347280268Z [2024-07-04T03:40:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:38:00+00:00 exited with status queued for try_number 1 2024-07-04T03:40:01.349621082Z [2024-07-04T03:40:01.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:39:00+00:00 exited with status queued for try_number 1 2024-07-04T03:40:01.350469359Z [2024-07-04T03:40:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:39:00+00:00 exited with status queued for try_number 1 2024-07-04T03:40:01.362175131Z [2024-07-04T03:40:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb10cabb-b47b-4188-81d8-2004d7df9147 2024-07-04T03:40:01.362440251Z [2024-07-04T03:40:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0522e69e-e1c2-4b46-9421-836481d4de1d 2024-07-04T03:40:01.363179173Z [2024-07-04T03:40:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e4eb8c1-5987-4ec0-a953-8d9fdd3c6fb7 2024-07-04T03:40:01.363909430Z [2024-07-04T03:40:01.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to 331cbd7f-64b6-47ca-8c55-6e5a1e888711 2024-07-04T03:40:03.171560367Z [2024-07-04T03:40:03.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:40:03.172107937Z [2024-07-04T03:40:03.171+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:38:00+00:00, run_id=scheduled__2024-07-04T03:38:00+00:00, run_start_date=2024-07-04 03:40:00.670044+00:00, run_end_date=2024-07-04 03:40:03.171484+00:00, run_duration=2.50144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:38:00+00:00, data_interval_end=2024-07-04 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:40:03.181719059Z [2024-07-04T03:40:03.181+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:40:00+00:00, run_after=2024-07-04T03:42:00+00:00 2024-07-04T03:40:03.255850372Z [2024-07-04T03:40:03.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:38:00+00:00 exited with status success for try_number 1 2024-07-04T03:40:03.271767253Z [2024-07-04T03:40:03.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:38:00+00:00, map_index=-1, run_start_date=2024-07-04 03:40:02.086740+00:00, run_end_date=2024-07-04 03:40:02.582025+00:00, run_duration=0.495285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:40:00.743066+00:00, queued_by_job_id=2, pid=10509 2024-07-04T03:40:04.744837426Z [2024-07-04T03:40:04.744+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:40:04.744867312Z 2024-07-04T03:40:04.746661854Z [2024-07-04T03:40:04.744+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:40:04.746682127Z [2024-07-04T03:40:04.746+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:40:04.746688114Z 2024-07-04T03:40:04.749261771Z [2024-07-04T03:40:04.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:40:04.749405332Z [2024-07-04T03:40:04.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:40:04.831884761Z [2024-07-04T03:40:04.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status queued for try_number 1 2024-07-04T03:40:04.832049036Z [2024-07-04T03:40:04.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status success for try_number 1 2024-07-04T03:40:04.841266146Z [2024-07-04T03:40:04.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to d829a490-e09f-40c8-85df-363b5e1310b4 2024-07-04T03:40:04.841295270Z [2024-07-04T03:40:04.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:35:00+00:00, map_index=-1, run_start_date=2024-07-04 03:40:03.425111+00:00, run_end_date=2024-07-04 03:40:03.914302+00:00, run_duration=0.489191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:40:00.743066+00:00, queued_by_job_id=2, pid=10550 2024-07-04T03:40:04.888230405Z [2024-07-04T03:40:04.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:40:04.888503676Z [2024-07-04T03:40:04.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:39:00+00:00, run_id=scheduled__2024-07-04T03:39:00+00:00, run_start_date=2024-07-04 03:40:00.671512+00:00, run_end_date=2024-07-04 03:40:04.888073+00:00, run_duration=4.216561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:39:00+00:00, data_interval_end=2024-07-04 03:40:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:40:04.897496304Z [2024-07-04T03:40:04.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:40:00+00:00, run_after=2024-07-04T03:41:00+00:00 2024-07-04T03:40:04.964091023Z [2024-07-04T03:40:04.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:39:00+00:00 exited with status success for try_number 1 2024-07-04T03:40:04.976952196Z [2024-07-04T03:40:04.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:39:00+00:00, map_index=-1, run_start_date=2024-07-04 03:40:03.160697+00:00, run_end_date=2024-07-04 03:40:04.691974+00:00, run_duration=1.531277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:40:00.743066+00:00, queued_by_job_id=2, pid=10543 2024-07-04T03:40:06.041215381Z [2024-07-04T03:40:06.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:40:06.041870581Z [2024-07-04T03:40:06.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:39:00+00:00, run_id=scheduled__2024-07-04T03:39:00+00:00, run_start_date=2024-07-04 03:40:00.672938+00:00, run_end_date=2024-07-04 03:40:06.041071+00:00, run_duration=5.368133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:39:00+00:00, data_interval_end=2024-07-04 03:40:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:40:06.056220295Z [2024-07-04T03:40:06.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:40:00+00:00, run_after=2024-07-04T03:41:00+00:00 2024-07-04T03:40:06.127773587Z [2024-07-04T03:40:06.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:39:00+00:00 exited with status success for try_number 1 2024-07-04T03:40:06.137316251Z [2024-07-04T03:40:06.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:39:00+00:00, map_index=-1, run_start_date=2024-07-04 03:40:03.513529+00:00, run_end_date=2024-07-04 03:40:05.273596+00:00, run_duration=1.760067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:40:00.743066+00:00, queued_by_job_id=2, pid=10551 2024-07-04T03:40:08.160642368Z [2024-07-04T03:40:08.159+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:40:08.160680567Z 2024-07-04T03:40:08.161415078Z [2024-07-04T03:40:08.160+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:40:08.164386201Z [2024-07-04T03:40:08.163+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:40:08.164419105Z 2024-07-04T03:40:08.171800967Z [2024-07-04T03:40:08.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:40:08.172283235Z [2024-07-04T03:40:08.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:40:08.244574633Z [2024-07-04T03:40:08.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status queued for try_number 1 2024-07-04T03:40:08.244819977Z [2024-07-04T03:40:08.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status success for try_number 1 2024-07-04T03:40:08.251437095Z [2024-07-04T03:40:08.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to f209259a-d793-4758-9259-94d315c152d6 2024-07-04T03:40:08.251741553Z [2024-07-04T03:40:08.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:35:00+00:00, map_index=-1, run_start_date=2024-07-04 03:40:06.612182+00:00, run_end_date=2024-07-04 03:40:07.059250+00:00, run_duration=0.447068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:40:04.746684+00:00, queued_by_job_id=2, pid=10590 2024-07-04T03:40:10.979530034Z [2024-07-04T03:40:10.979+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:40:10.979574993Z 2024-07-04T03:40:10.979709354Z [2024-07-04T03:40:10.979+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:40:10.980444654Z [2024-07-04T03:40:10.980+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:40:10.980458361Z 2024-07-04T03:40:10.983565956Z [2024-07-04T03:40:10.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:40:10.983675305Z [2024-07-04T03:40:10.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:40:11.057944341Z [2024-07-04T03:40:11.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status queued for try_number 1 2024-07-04T03:40:11.058280343Z [2024-07-04T03:40:11.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status success for try_number 1 2024-07-04T03:40:11.068399314Z [2024-07-04T03:40:11.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to f77388d5-afcf-4f9e-9d95-59b71cf3142b 2024-07-04T03:40:11.068836318Z [2024-07-04T03:40:11.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:35:00+00:00, map_index=0, run_start_date=2024-07-04 03:40:10.027858+00:00, run_end_date=2024-07-04 03:40:10.435232+00:00, run_duration=0.407374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:40:08.165636+00:00, queued_by_job_id=2, pid=10602 2024-07-04T03:40:13.811787312Z [2024-07-04T03:40:13.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:40:13.812537335Z [2024-07-04T03:40:13.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:35:00+00:00, run_id=scheduled__2024-07-04T03:35:00+00:00, run_start_date=2024-07-04 03:40:00.667958+00:00, run_end_date=2024-07-04 03:40:13.811867+00:00, run_duration=13.143909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:35:00+00:00, data_interval_end=2024-07-04 03:40:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:40:13.823911416Z [2024-07-04T03:40:13.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:40:00+00:00, run_after=2024-07-04T03:45:00+00:00 2024-07-04T03:40:13.864168270Z [2024-07-04T03:40:13.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:35:00+00:00 exited with status success for try_number 1 2024-07-04T03:40:13.871257541Z [2024-07-04T03:40:13.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:35:00+00:00, map_index=-1, run_start_date=2024-07-04 03:40:12.953174+00:00, run_end_date=2024-07-04 03:40:13.404174+00:00, run_duration=0.451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:40:10.981021+00:00, queued_by_job_id=2, pid=10614 2024-07-04T03:40:29.109629442Z [2024-07-04T03:40:29.109+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:40:29.109662122Z 2024-07-04T03:40:29.109821492Z [2024-07-04T03:40:29.109+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-07-04T03:40:29.112166853Z [2024-07-04T03:40:29.111+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:40:29.112184328Z 2024-07-04T03:40:29.115299098Z [2024-07-04T03:40:29.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240704034028_745144', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:40:29.115661634Z [2024-07-04T03:40:29.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240704034028_745144', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-07-04T03:40:29.183115340Z [2024-07-04T03:40:29.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240704034028_745144 exited with status queued for try_number 1 2024-07-04T03:40:29.197180631Z [2024-07-04T03:40:29.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33494055-a013-4cc0-b2e6-9cbc515bdb6f 2024-07-04T03:40:31.043732822Z [2024-07-04T03:40:31.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:40:31.044101500Z [2024-07-04T03:40:31.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-07-04 03:40:28.839449+00:00, run_id=vdu_alarm_20240704034028_745144, run_start_date=2024-07-04 03:40:29.074561+00:00, run_end_date=2024-07-04 03:40:31.043568+00:00, run_duration=1.969007, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-07-04 03:40:28.839449+00:00, data_interval_end=2024-07-04 03:40:28.839449+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-07-04T03:40:31.047242010Z [2024-07-04T03:40:31.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-07-04T03:40:31.076445209Z [2024-07-04T03:40:31.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240704034028_745144 exited with status success for try_number 1 2024-07-04T03:40:31.084429017Z [2024-07-04T03:40:31.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240704034028_745144, map_index=-1, run_start_date=2024-07-04 03:40:29.859378+00:00, run_end_date=2024-07-04 03:40:30.245204+00:00, run_duration=0.385826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:40:29.112714+00:00, queued_by_job_id=2, pid=10616 2024-07-04T03:41:00.723252723Z [2024-07-04T03:41:00.722+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:41:00.750684812Z [2024-07-04T03:41:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:41:00+00:00, run_after=2024-07-04T03:42:00+00:00 2024-07-04T03:41:00.838050523Z [2024-07-04T03:41:00.837+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:41:00.838092416Z 2024-07-04T03:41:00.838096241Z 2024-07-04T03:41:00.839961515Z [2024-07-04T03:41:00.837+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:41:00.840196408Z [2024-07-04T03:41:00.839+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:41:00.841000223Z [2024-07-04T03:41:00.840+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:41:00.841012518Z 2024-07-04T03:41:00.841023242Z 2024-07-04T03:41:00.844193948Z [2024-07-04T03:41:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:41:00.844271218Z [2024-07-04T03:41:00.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:41:00.844529533Z [2024-07-04T03:41:00.844+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:41:00.844664098Z [2024-07-04T03:41:00.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:41:01.080679694Z [2024-07-04T03:41:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status queued for try_number 1 2024-07-04T03:41:01.080708622Z [2024-07-04T03:41:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status queued for try_number 1 2024-07-04T03:41:01.097007599Z [2024-07-04T03:41:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d984a69-68f7-4982-8081-3896971e7126 2024-07-04T03:41:01.097079641Z [2024-07-04T03:41:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88205ed1-aa82-4da7-b508-724025d3d57c 2024-07-04T03:41:04.512321219Z [2024-07-04T03:41:04.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:41:04.512691563Z [2024-07-04T03:41:04.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:40:00+00:00, run_id=scheduled__2024-07-04T03:40:00+00:00, run_start_date=2024-07-04 03:41:00.764519+00:00, run_end_date=2024-07-04 03:41:04.512147+00:00, run_duration=3.747628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:40:00+00:00, data_interval_end=2024-07-04 03:41:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:41:04.524316867Z [2024-07-04T03:41:04.523+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:41:00+00:00, run_after=2024-07-04T03:42:00+00:00 2024-07-04T03:41:04.531387859Z [2024-07-04T03:41:04.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:41:04.531621657Z [2024-07-04T03:41:04.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:40:00+00:00, run_id=scheduled__2024-07-04T03:40:00+00:00, run_start_date=2024-07-04 03:41:00.765896+00:00, run_end_date=2024-07-04 03:41:04.531248+00:00, run_duration=3.765352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:40:00+00:00, data_interval_end=2024-07-04 03:41:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:41:04.540804138Z [2024-07-04T03:41:04.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:41:00+00:00, run_after=2024-07-04T03:42:00+00:00 2024-07-04T03:41:04.581292249Z [2024-07-04T03:41:04.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status success for try_number 1 2024-07-04T03:41:04.581568501Z [2024-07-04T03:41:04.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status success for try_number 1 2024-07-04T03:41:04.595514582Z [2024-07-04T03:41:04.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:40:00+00:00, map_index=-1, run_start_date=2024-07-04 03:41:02.761887+00:00, run_end_date=2024-07-04 03:41:04.077970+00:00, run_duration=1.316083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:41:00.841557+00:00, queued_by_job_id=2, pid=10663 2024-07-04T03:41:04.595810463Z [2024-07-04T03:41:04.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:40:00+00:00, map_index=-1, run_start_date=2024-07-04 03:41:02.690452+00:00, run_end_date=2024-07-04 03:41:04.310691+00:00, run_duration=1.620239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:41:00.841557+00:00, queued_by_job_id=2, pid=10662 2024-07-04T03:41:22.835186837Z [2024-07-04T03:41:22.834+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:42:00.508234261Z [2024-07-04T03:42:00.507+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:42:00.517972954Z [2024-07-04T03:42:00.517+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:42:00.533193721Z [2024-07-04T03:42:00.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:42:00+00:00, run_after=2024-07-04T03:43:00+00:00 2024-07-04T03:42:00.611078904Z [2024-07-04T03:42:00.610+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:42:00.611118516Z 2024-07-04T03:42:00.611125059Z 2024-07-04T03:42:00.611130476Z 2024-07-04T03:42:00.611145617Z [2024-07-04T03:42:00.610+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:42:00.611170166Z [2024-07-04T03:42:00.611+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:42:00.611273235Z [2024-07-04T03:42:00.611+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:42:00.611870516Z [2024-07-04T03:42:00.611+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:42:00.611880273Z 2024-07-04T03:42:00.611885737Z 2024-07-04T03:42:00.611893808Z 2024-07-04T03:42:00.615564381Z [2024-07-04T03:42:00.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:42:00.615676799Z [2024-07-04T03:42:00.615+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:42:00.615863577Z [2024-07-04T03:42:00.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:42:00.615960328Z [2024-07-04T03:42:00.615+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:42:00.616194558Z [2024-07-04T03:42:00.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:42:00.616220792Z [2024-07-04T03:42:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:42:01.133081563Z [2024-07-04T03:42:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status queued for try_number 1 2024-07-04T03:42:01.133135237Z [2024-07-04T03:42:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:41:00+00:00 exited with status queued for try_number 1 2024-07-04T03:42:01.133146808Z [2024-07-04T03:42:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:41:00+00:00 exited with status queued for try_number 1 2024-07-04T03:42:01.144004328Z [2024-07-04T03:42:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9970ad37-4bec-4317-b047-728ca3821db5 2024-07-04T03:42:01.144080330Z [2024-07-04T03:42:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80847c98-139d-49a3-9cb3-db5696196a9a 2024-07-04T03:42:01.144190312Z [2024-07-04T03:42:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d11ab43-ce08-436c-bb62-aa6bcd588916 2024-07-04T03:42:02.643883894Z [2024-07-04T03:42:02.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:42:02.644081730Z [2024-07-04T03:42:02.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:40:00+00:00, run_id=scheduled__2024-07-04T03:40:00+00:00, run_start_date=2024-07-04 03:42:00.549169+00:00, run_end_date=2024-07-04 03:42:02.643804+00:00, run_duration=2.094635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:40:00+00:00, data_interval_end=2024-07-04 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:42:02.656194752Z [2024-07-04T03:42:02.655+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:42:00+00:00, run_after=2024-07-04T03:44:00+00:00 2024-07-04T03:42:03.893998706Z [2024-07-04T03:42:03.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status success for try_number 1 2024-07-04T03:42:03.914937074Z [2024-07-04T03:42:03.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:40:00+00:00, map_index=-1, run_start_date=2024-07-04 03:42:01.842313+00:00, run_end_date=2024-07-04 03:42:02.596573+00:00, run_duration=0.75426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:42:00.612584+00:00, queued_by_job_id=2, pid=10698 2024-07-04T03:42:06.084407246Z [2024-07-04T03:42:06.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:42:06.084927689Z [2024-07-04T03:42:06.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:41:00+00:00, run_id=scheduled__2024-07-04T03:41:00+00:00, run_start_date=2024-07-04 03:42:00.550859+00:00, run_end_date=2024-07-04 03:42:06.084189+00:00, run_duration=5.53333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:41:00+00:00, data_interval_end=2024-07-04 03:42:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:42:06.098074112Z [2024-07-04T03:42:06.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:42:00+00:00, run_after=2024-07-04T03:43:00+00:00 2024-07-04T03:42:06.110121386Z [2024-07-04T03:42:06.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:42:06.110507304Z [2024-07-04T03:42:06.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:41:00+00:00, run_id=scheduled__2024-07-04T03:41:00+00:00, run_start_date=2024-07-04 03:42:00.552174+00:00, run_end_date=2024-07-04 03:42:06.109990+00:00, run_duration=5.557816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:41:00+00:00, data_interval_end=2024-07-04 03:42:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:42:06.122005811Z [2024-07-04T03:42:06.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:42:00+00:00, run_after=2024-07-04T03:43:00+00:00 2024-07-04T03:42:06.169184273Z [2024-07-04T03:42:06.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:41:00+00:00 exited with status success for try_number 1 2024-07-04T03:42:06.178783415Z [2024-07-04T03:42:06.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:41:00+00:00, map_index=-1, run_start_date=2024-07-04 03:42:03.249030+00:00, run_end_date=2024-07-04 03:42:05.405710+00:00, run_duration=2.15668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:42:00.612584+00:00, queued_by_job_id=2, pid=10728 2024-07-04T03:42:07.296265190Z [2024-07-04T03:42:07.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:41:00+00:00 exited with status success for try_number 1 2024-07-04T03:42:07.301918088Z [2024-07-04T03:42:07.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:41:00+00:00, map_index=-1, run_start_date=2024-07-04 03:42:03.251541+00:00, run_end_date=2024-07-04 03:42:06.010403+00:00, run_duration=2.758862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:42:00.612584+00:00, queued_by_job_id=2, pid=10729 2024-07-04T03:43:00.396339555Z [2024-07-04T03:43:00.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:43:00+00:00, run_after=2024-07-04T03:44:00+00:00 2024-07-04T03:43:00.405937898Z [2024-07-04T03:43:00.405+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:43:00.470746771Z [2024-07-04T03:43:00.470+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:43:00.470768076Z 2024-07-04T03:43:00.470771501Z 2024-07-04T03:43:00.470938045Z [2024-07-04T03:43:00.470+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:43:00.471115612Z [2024-07-04T03:43:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:43:00.471855412Z [2024-07-04T03:43:00.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:43:00.471882369Z 2024-07-04T03:43:00.471885858Z 2024-07-04T03:43:00.476543755Z [2024-07-04T03:43:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:43:00.476650685Z [2024-07-04T03:43:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:43:00.476831656Z [2024-07-04T03:43:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:43:00.476895335Z [2024-07-04T03:43:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:43:00.711092941Z [2024-07-04T03:43:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:42:00+00:00 exited with status queued for try_number 1 2024-07-04T03:43:00.711170338Z [2024-07-04T03:43:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:42:00+00:00 exited with status queued for try_number 1 2024-07-04T03:43:00.725230945Z [2024-07-04T03:43:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61b4c79f-8d7b-43ff-b4ca-a474aaa56503 2024-07-04T03:43:00.725431218Z [2024-07-04T03:43:00.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6fa54f0-a517-433c-afe3-9296e1bca9f1 2024-07-04T03:43:04.212774826Z [2024-07-04T03:43:04.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:43:04.213081243Z [2024-07-04T03:43:04.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:42:00+00:00, run_id=scheduled__2024-07-04T03:42:00+00:00, run_start_date=2024-07-04 03:43:00.417636+00:00, run_end_date=2024-07-04 03:43:04.212588+00:00, run_duration=3.794952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:42:00+00:00, data_interval_end=2024-07-04 03:43:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:43:04.227219976Z [2024-07-04T03:43:04.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:43:00+00:00, run_after=2024-07-04T03:44:00+00:00 2024-07-04T03:43:04.290500252Z [2024-07-04T03:43:04.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:42:00+00:00 exited with status success for try_number 1 2024-07-04T03:43:04.296332419Z [2024-07-04T03:43:04.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:42:00+00:00, map_index=-1, run_start_date=2024-07-04 03:43:02.286326+00:00, run_end_date=2024-07-04 03:43:03.881540+00:00, run_duration=1.595214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:43:00.472683+00:00, queued_by_job_id=2, pid=10782 2024-07-04T03:43:05.346672006Z [2024-07-04T03:43:05.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:43:05.347594225Z [2024-07-04T03:43:05.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:42:00+00:00, run_id=scheduled__2024-07-04T03:42:00+00:00, run_start_date=2024-07-04 03:43:00.419219+00:00, run_end_date=2024-07-04 03:43:05.347076+00:00, run_duration=4.927857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:42:00+00:00, data_interval_end=2024-07-04 03:43:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:43:05.357132113Z [2024-07-04T03:43:05.356+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:43:00+00:00, run_after=2024-07-04T03:44:00+00:00 2024-07-04T03:43:05.399712273Z [2024-07-04T03:43:05.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:42:00+00:00 exited with status success for try_number 1 2024-07-04T03:43:05.411332249Z [2024-07-04T03:43:05.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:42:00+00:00, map_index=-1, run_start_date=2024-07-04 03:43:02.414180+00:00, run_end_date=2024-07-04 03:43:05.072964+00:00, run_duration=2.658784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:43:00.472683+00:00, queued_by_job_id=2, pid=10783 2024-07-04T03:44:00.807403760Z [2024-07-04T03:44:00.804+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:44:00.824903987Z [2024-07-04T03:44:00.824+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:44:00.845263208Z [2024-07-04T03:44:00.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:44:00+00:00, run_after=2024-07-04T03:45:00+00:00 2024-07-04T03:44:00.935062237Z [2024-07-04T03:44:00.934+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:44:00.935100374Z 2024-07-04T03:44:00.935106765Z 2024-07-04T03:44:00.935130449Z 2024-07-04T03:44:00.935192002Z [2024-07-04T03:44:00.934+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:44:00.935203636Z [2024-07-04T03:44:00.935+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:44:00.935313113Z [2024-07-04T03:44:00.935+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:44:00.936026667Z [2024-07-04T03:44:00.935+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:44:00.936042685Z 2024-07-04T03:44:00.936047023Z 2024-07-04T03:44:00.936050527Z 2024-07-04T03:44:00.960159461Z [2024-07-04T03:44:00.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:44:00.961169112Z [2024-07-04T03:44:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:44:00.961199835Z [2024-07-04T03:44:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:44:00.961206661Z [2024-07-04T03:44:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:44:00.961212104Z [2024-07-04T03:44:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:44:00.961217682Z [2024-07-04T03:44:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:44:01.342247413Z [2024-07-04T03:44:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:42:00+00:00 exited with status queued for try_number 1 2024-07-04T03:44:01.342502159Z [2024-07-04T03:44:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:43:00+00:00 exited with status queued for try_number 1 2024-07-04T03:44:01.342672456Z [2024-07-04T03:44:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:43:00+00:00 exited with status queued for try_number 1 2024-07-04T03:44:01.358726949Z [2024-07-04T03:44:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05c7dad3-b2dc-41aa-bbd5-e9b17a74837d 2024-07-04T03:44:01.359109189Z [2024-07-04T03:44:01.358+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97cf2b88-5818-4b04-82a8-1e1f490bc921 2024-07-04T03:44:01.359381809Z [2024-07-04T03:44:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 045fa271-b869-4b07-8af1-75aa9bcdf443 2024-07-04T03:44:02.571749119Z [2024-07-04T03:44:02.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:44:02.572455497Z [2024-07-04T03:44:02.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:42:00+00:00, run_id=scheduled__2024-07-04T03:42:00+00:00, run_start_date=2024-07-04 03:44:00.861484+00:00, run_end_date=2024-07-04 03:44:02.571845+00:00, run_duration=1.710361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:42:00+00:00, data_interval_end=2024-07-04 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:44:02.590862161Z [2024-07-04T03:44:02.590+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:44:00+00:00, run_after=2024-07-04T03:46:00+00:00 2024-07-04T03:44:02.701292664Z [2024-07-04T03:44:02.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:42:00+00:00 exited with status success for try_number 1 2024-07-04T03:44:02.710512778Z [2024-07-04T03:44:02.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:42:00+00:00, map_index=-1, run_start_date=2024-07-04 03:44:01.884568+00:00, run_end_date=2024-07-04 03:44:02.329436+00:00, run_duration=0.444868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:44:00.944432+00:00, queued_by_job_id=2, pid=10818 2024-07-04T03:44:05.621903759Z [2024-07-04T03:44:05.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:44:05.622312692Z [2024-07-04T03:44:05.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:43:00+00:00, run_id=scheduled__2024-07-04T03:43:00+00:00, run_start_date=2024-07-04 03:44:00.863179+00:00, run_end_date=2024-07-04 03:44:05.621785+00:00, run_duration=4.758606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:43:00+00:00, data_interval_end=2024-07-04 03:44:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:44:05.633844338Z [2024-07-04T03:44:05.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:44:00+00:00, run_after=2024-07-04T03:45:00+00:00 2024-07-04T03:44:05.669995809Z [2024-07-04T03:44:05.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:43:00+00:00 exited with status success for try_number 1 2024-07-04T03:44:05.677154719Z [2024-07-04T03:44:05.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:43:00+00:00, map_index=-1, run_start_date=2024-07-04 03:44:03.074369+00:00, run_end_date=2024-07-04 03:44:04.935214+00:00, run_duration=1.860845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:44:00.944432+00:00, queued_by_job_id=2, pid=10848 2024-07-04T03:44:06.725715799Z [2024-07-04T03:44:06.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:44:06.726176884Z [2024-07-04T03:44:06.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:43:00+00:00, run_id=scheduled__2024-07-04T03:43:00+00:00, run_start_date=2024-07-04 03:44:00.864518+00:00, run_end_date=2024-07-04 03:44:06.725606+00:00, run_duration=5.861088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:43:00+00:00, data_interval_end=2024-07-04 03:44:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:44:06.734601513Z [2024-07-04T03:44:06.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:44:00+00:00, run_after=2024-07-04T03:45:00+00:00 2024-07-04T03:44:06.763712704Z [2024-07-04T03:44:06.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:43:00+00:00 exited with status success for try_number 1 2024-07-04T03:44:06.769395974Z [2024-07-04T03:44:06.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:43:00+00:00, map_index=-1, run_start_date=2024-07-04 03:44:03.311937+00:00, run_end_date=2024-07-04 03:44:05.523640+00:00, run_duration=2.211703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:44:00.944432+00:00, queued_by_job_id=2, pid=10849 2024-07-04T03:45:00.138857597Z [2024-07-04T03:45:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:45:00+00:00, run_after=2024-07-04T03:46:00+00:00 2024-07-04T03:45:00.147829730Z [2024-07-04T03:45:00.147+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:45:00.160653788Z [2024-07-04T03:45:00.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:45:00+00:00, run_after=2024-07-04T03:50:00+00:00 2024-07-04T03:45:00.259859188Z [2024-07-04T03:45:00.259+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:45:00.259889625Z 2024-07-04T03:45:00.259909456Z 2024-07-04T03:45:00.259912875Z 2024-07-04T03:45:00.260116701Z [2024-07-04T03:45:00.259+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:45:00.260273368Z [2024-07-04T03:45:00.260+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:45:00.260447731Z [2024-07-04T03:45:00.260+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:45:00.261696640Z [2024-07-04T03:45:00.261+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:45:00.261715954Z 2024-07-04T03:45:00.261722936Z 2024-07-04T03:45:00.261728262Z 2024-07-04T03:45:00.271299318Z [2024-07-04T03:45:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:45:00.271846197Z [2024-07-04T03:45:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:45:00.272446712Z [2024-07-04T03:45:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:45:00.272740575Z [2024-07-04T03:45:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:45:00.273217194Z [2024-07-04T03:45:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:45:00.273604385Z [2024-07-04T03:45:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:45:00.800392157Z [2024-07-04T03:45:00.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status queued for try_number 1 2024-07-04T03:45:00.803332677Z [2024-07-04T03:45:00.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:44:00+00:00 exited with status queued for try_number 1 2024-07-04T03:45:00.803660850Z [2024-07-04T03:45:00.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:44:00+00:00 exited with status queued for try_number 1 2024-07-04T03:45:00.835737037Z [2024-07-04T03:45:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to d247c03b-52be-417b-a113-bc0280645fa3 2024-07-04T03:45:00.835935640Z [2024-07-04T03:45:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to afa95787-915b-4225-94cf-b00a59abcf98 2024-07-04T03:45:00.836049030Z [2024-07-04T03:45:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ed759c7-3c0c-4c2d-8412-ab6b5de143cb 2024-07-04T03:45:03.431892672Z [2024-07-04T03:45:03.431+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:45:03.431930621Z 2024-07-04T03:45:03.431935692Z [2024-07-04T03:45:03.431+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:45:03.432522834Z [2024-07-04T03:45:03.432+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:45:03.432549902Z 2024-07-04T03:45:03.435896907Z [2024-07-04T03:45:03.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:45:03.435950109Z [2024-07-04T03:45:03.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:45:03.503379810Z [2024-07-04T03:45:03.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status queued for try_number 1 2024-07-04T03:45:03.503651936Z [2024-07-04T03:45:03.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status success for try_number 1 2024-07-04T03:45:03.509467998Z [2024-07-04T03:45:03.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to eacafeec-b225-4718-88dd-8bf975e8d1b9 2024-07-04T03:45:03.509757934Z [2024-07-04T03:45:03.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:40:00+00:00, map_index=-1, run_start_date=2024-07-04 03:45:02.760816+00:00, run_end_date=2024-07-04 03:45:03.187508+00:00, run_duration=0.426692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:45:00.263901+00:00, queued_by_job_id=2, pid=10906 2024-07-04T03:45:05.169043758Z [2024-07-04T03:45:05.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:45:05.169465528Z [2024-07-04T03:45:05.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:44:00+00:00, run_id=scheduled__2024-07-04T03:44:00+00:00, run_start_date=2024-07-04 03:45:00.181343+00:00, run_end_date=2024-07-04 03:45:05.168977+00:00, run_duration=4.987634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:44:00+00:00, data_interval_end=2024-07-04 03:45:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:45:05.179346188Z [2024-07-04T03:45:05.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:45:00+00:00, run_after=2024-07-04T03:46:00+00:00 2024-07-04T03:45:05.188592277Z [2024-07-04T03:45:05.188+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:45:05.189713527Z [2024-07-04T03:45:05.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:44:00+00:00, run_id=scheduled__2024-07-04T03:44:00+00:00, run_start_date=2024-07-04 03:45:00.182782+00:00, run_end_date=2024-07-04 03:45:05.188522+00:00, run_duration=5.00574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:44:00+00:00, data_interval_end=2024-07-04 03:45:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:45:05.201609456Z [2024-07-04T03:45:05.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:45:00+00:00, run_after=2024-07-04T03:46:00+00:00 2024-07-04T03:45:05.255805028Z [2024-07-04T03:45:05.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:44:00+00:00 exited with status success for try_number 1 2024-07-04T03:45:05.256050439Z [2024-07-04T03:45:05.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:44:00+00:00 exited with status success for try_number 1 2024-07-04T03:45:05.263780389Z [2024-07-04T03:45:05.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:44:00+00:00, map_index=-1, run_start_date=2024-07-04 03:45:03.068983+00:00, run_end_date=2024-07-04 03:45:04.421530+00:00, run_duration=1.352547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:45:00.263901+00:00, queued_by_job_id=2, pid=10922 2024-07-04T03:45:05.264306260Z [2024-07-04T03:45:05.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:44:00+00:00, map_index=-1, run_start_date=2024-07-04 03:45:03.007052+00:00, run_end_date=2024-07-04 03:45:04.750006+00:00, run_duration=1.742954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:45:00.263901+00:00, queued_by_job_id=2, pid=10916 2024-07-04T03:45:06.338443686Z [2024-07-04T03:45:06.338+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:45:06.338475101Z 2024-07-04T03:45:06.338626400Z [2024-07-04T03:45:06.338+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:45:06.339351450Z [2024-07-04T03:45:06.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:45:06.339375840Z 2024-07-04T03:45:06.341679905Z [2024-07-04T03:45:06.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:45:06.341887484Z [2024-07-04T03:45:06.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:45:06.418392069Z [2024-07-04T03:45:06.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status queued for try_number 1 2024-07-04T03:45:06.418767471Z [2024-07-04T03:45:06.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status success for try_number 1 2024-07-04T03:45:06.425239548Z [2024-07-04T03:45:06.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad6508a8-0ac7-469c-9cbf-6d720afc9c5a 2024-07-04T03:45:06.425799621Z [2024-07-04T03:45:06.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:40:00+00:00, map_index=-1, run_start_date=2024-07-04 03:45:05.312530+00:00, run_end_date=2024-07-04 03:45:05.728155+00:00, run_duration=0.415625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:45:03.432816+00:00, queued_by_job_id=2, pid=10956 2024-07-04T03:45:08.747119592Z [2024-07-04T03:45:08.746+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:45:08.747149355Z 2024-07-04T03:45:08.747341828Z [2024-07-04T03:45:08.747+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:45:08.747901140Z [2024-07-04T03:45:08.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:45:08.747928935Z 2024-07-04T03:45:08.751498604Z [2024-07-04T03:45:08.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:45:08.751571872Z [2024-07-04T03:45:08.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:45:08.807165822Z [2024-07-04T03:45:08.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status queued for try_number 1 2024-07-04T03:45:08.807203392Z [2024-07-04T03:45:08.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status success for try_number 1 2024-07-04T03:45:08.815254174Z [2024-07-04T03:45:08.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a32d72b-8348-4703-b8d2-3146daad8aea 2024-07-04T03:45:08.815359797Z [2024-07-04T03:45:08.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:40:00+00:00, map_index=0, run_start_date=2024-07-04 03:45:08.086100+00:00, run_end_date=2024-07-04 03:45:08.560378+00:00, run_duration=0.474278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:45:06.339813+00:00, queued_by_job_id=2, pid=10967 2024-07-04T03:45:11.354765213Z [2024-07-04T03:45:11.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:45:11.355093138Z [2024-07-04T03:45:11.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:40:00+00:00, run_id=scheduled__2024-07-04T03:40:00+00:00, run_start_date=2024-07-04 03:45:00.179630+00:00, run_end_date=2024-07-04 03:45:11.354632+00:00, run_duration=11.175002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:40:00+00:00, data_interval_end=2024-07-04 03:45:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:45:11.363228532Z [2024-07-04T03:45:11.362+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:45:00+00:00, run_after=2024-07-04T03:50:00+00:00 2024-07-04T03:45:11.403985469Z [2024-07-04T03:45:11.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:40:00+00:00 exited with status success for try_number 1 2024-07-04T03:45:11.415049364Z [2024-07-04T03:45:11.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:40:00+00:00, map_index=-1, run_start_date=2024-07-04 03:45:10.503503+00:00, run_end_date=2024-07-04 03:45:10.837065+00:00, run_duration=0.333562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:45:08.749342+00:00, queued_by_job_id=2, pid=10979 2024-07-04T03:46:01.043394854Z [2024-07-04T03:46:01.042+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:46:01.063242816Z [2024-07-04T03:46:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:46:00+00:00, run_after=2024-07-04T03:47:00+00:00 2024-07-04T03:46:01.073890565Z [2024-07-04T03:46:01.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:46:01.172157352Z [2024-07-04T03:46:01.171+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:46:01.172213587Z 2024-07-04T03:46:01.172224608Z 2024-07-04T03:46:01.172234605Z 2024-07-04T03:46:01.172312372Z [2024-07-04T03:46:01.172+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:46:01.172338636Z [2024-07-04T03:46:01.172+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:46:01.172488388Z [2024-07-04T03:46:01.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:46:01.173118839Z [2024-07-04T03:46:01.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:46:01.173132318Z 2024-07-04T03:46:01.173138319Z 2024-07-04T03:46:01.173160981Z 2024-07-04T03:46:01.177394237Z [2024-07-04T03:46:01.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:46:01.177477690Z [2024-07-04T03:46:01.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:46:01.177676502Z [2024-07-04T03:46:01.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:46:01.177798626Z [2024-07-04T03:46:01.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:46:01.178115282Z [2024-07-04T03:46:01.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:46:01.178248396Z [2024-07-04T03:46:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:46:01.456348723Z [2024-07-04T03:46:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:44:00+00:00 exited with status queued for try_number 1 2024-07-04T03:46:01.456539455Z [2024-07-04T03:46:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status queued for try_number 1 2024-07-04T03:46:01.456737143Z [2024-07-04T03:46:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status queued for try_number 1 2024-07-04T03:46:01.473927387Z [2024-07-04T03:46:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 632b2e1e-8a7e-4a58-b073-9045ac83b172 2024-07-04T03:46:01.474113819Z [2024-07-04T03:46:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to c401f804-5ca0-4e2e-b3f6-83737a24ec86 2024-07-04T03:46:01.474259124Z [2024-07-04T03:46:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 885e42c4-89db-4588-8c12-afccf310d806 2024-07-04T03:46:02.617107543Z [2024-07-04T03:46:02.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:46:02.617502997Z [2024-07-04T03:46:02.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:44:00+00:00, run_id=scheduled__2024-07-04T03:44:00+00:00, run_start_date=2024-07-04 03:46:01.087869+00:00, run_end_date=2024-07-04 03:46:02.617025+00:00, run_duration=1.529156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:44:00+00:00, data_interval_end=2024-07-04 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:46:02.625430890Z [2024-07-04T03:46:02.625+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:46:00+00:00, run_after=2024-07-04T03:48:00+00:00 2024-07-04T03:46:02.678409931Z [2024-07-04T03:46:02.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:44:00+00:00 exited with status success for try_number 1 2024-07-04T03:46:02.685695525Z [2024-07-04T03:46:02.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:44:00+00:00, map_index=-1, run_start_date=2024-07-04 03:46:02.019527+00:00, run_end_date=2024-07-04 03:46:02.331271+00:00, run_duration=0.311744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:46:01.173944+00:00, queued_by_job_id=2, pid=10996 2024-07-04T03:46:05.054221225Z [2024-07-04T03:46:05.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:46:05.054462132Z [2024-07-04T03:46:05.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:45:00+00:00, run_id=scheduled__2024-07-04T03:45:00+00:00, run_start_date=2024-07-04 03:46:01.089522+00:00, run_end_date=2024-07-04 03:46:05.054034+00:00, run_duration=3.964512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:45:00+00:00, data_interval_end=2024-07-04 03:46:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:46:05.065893895Z [2024-07-04T03:46:05.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:46:00+00:00, run_after=2024-07-04T03:47:00+00:00 2024-07-04T03:46:05.105182850Z [2024-07-04T03:46:05.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status success for try_number 1 2024-07-04T03:46:05.110761536Z [2024-07-04T03:46:05.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:45:00+00:00, map_index=-1, run_start_date=2024-07-04 03:46:03.038700+00:00, run_end_date=2024-07-04 03:46:04.864594+00:00, run_duration=1.825894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:46:01.173944+00:00, queued_by_job_id=2, pid=11025 2024-07-04T03:46:06.167559023Z [2024-07-04T03:46:06.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:46:06.167728837Z [2024-07-04T03:46:06.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:45:00+00:00, run_id=scheduled__2024-07-04T03:45:00+00:00, run_start_date=2024-07-04 03:46:01.090809+00:00, run_end_date=2024-07-04 03:46:06.167388+00:00, run_duration=5.076579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:45:00+00:00, data_interval_end=2024-07-04 03:46:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:46:06.175998425Z [2024-07-04T03:46:06.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:46:00+00:00, run_after=2024-07-04T03:47:00+00:00 2024-07-04T03:46:06.203578368Z [2024-07-04T03:46:06.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status success for try_number 1 2024-07-04T03:46:06.208584019Z [2024-07-04T03:46:06.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:45:00+00:00, map_index=-1, run_start_date=2024-07-04 03:46:03.095045+00:00, run_end_date=2024-07-04 03:46:05.800559+00:00, run_duration=2.705514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:46:01.173944+00:00, queued_by_job_id=2, pid=11026 2024-07-04T03:46:22.900899876Z [2024-07-04T03:46:22.900+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:47:00.070568587Z [2024-07-04T03:47:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:47:00+00:00, run_after=2024-07-04T03:48:00+00:00 2024-07-04T03:47:00.079293596Z [2024-07-04T03:47:00.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:47:00.158102687Z [2024-07-04T03:47:00.157+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:47:00.158143388Z 2024-07-04T03:47:00.158152295Z 2024-07-04T03:47:00.158184061Z [2024-07-04T03:47:00.158+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:47:00.158374324Z [2024-07-04T03:47:00.158+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:47:00.159120480Z [2024-07-04T03:47:00.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:47:00.159135630Z 2024-07-04T03:47:00.159142836Z 2024-07-04T03:47:00.162946740Z [2024-07-04T03:47:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:47:00.163019616Z [2024-07-04T03:47:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:47:00.163318012Z [2024-07-04T03:47:00.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:47:00.163444139Z [2024-07-04T03:47:00.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:47:00.532494338Z [2024-07-04T03:47:00.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:46:00+00:00 exited with status queued for try_number 1 2024-07-04T03:47:00.533913796Z [2024-07-04T03:47:00.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:46:00+00:00 exited with status queued for try_number 1 2024-07-04T03:47:00.552051984Z [2024-07-04T03:47:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e2714cf-3e7e-47d7-a374-74844d6e1a9c 2024-07-04T03:47:00.552272249Z [2024-07-04T03:47:00.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to b51fcedf-09dd-4e92-bf7d-55c8d35fe809 2024-07-04T03:47:04.296106236Z [2024-07-04T03:47:04.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:47:04.296953917Z [2024-07-04T03:47:04.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:46:00+00:00, run_id=scheduled__2024-07-04T03:46:00+00:00, run_start_date=2024-07-04 03:47:00.092911+00:00, run_end_date=2024-07-04 03:47:04.296352+00:00, run_duration=4.203441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:46:00+00:00, data_interval_end=2024-07-04 03:47:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:47:04.310091874Z [2024-07-04T03:47:04.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:47:00+00:00, run_after=2024-07-04T03:48:00+00:00 2024-07-04T03:47:04.319954625Z [2024-07-04T03:47:04.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:47:04.320419043Z [2024-07-04T03:47:04.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:46:00+00:00, run_id=scheduled__2024-07-04T03:46:00+00:00, run_start_date=2024-07-04 03:47:00.094707+00:00, run_end_date=2024-07-04 03:47:04.319922+00:00, run_duration=4.225215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:46:00+00:00, data_interval_end=2024-07-04 03:47:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:47:04.330394428Z [2024-07-04T03:47:04.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:47:00+00:00, run_after=2024-07-04T03:48:00+00:00 2024-07-04T03:47:04.375738476Z [2024-07-04T03:47:04.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:46:00+00:00 exited with status success for try_number 1 2024-07-04T03:47:04.375905531Z [2024-07-04T03:47:04.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:46:00+00:00 exited with status success for try_number 1 2024-07-04T03:47:04.385312676Z [2024-07-04T03:47:04.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:46:00+00:00, map_index=-1, run_start_date=2024-07-04 03:47:02.184951+00:00, run_end_date=2024-07-04 03:47:03.439092+00:00, run_duration=1.254141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:47:00.159804+00:00, queued_by_job_id=2, pid=11081 2024-07-04T03:47:04.385627709Z [2024-07-04T03:47:04.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:46:00+00:00, map_index=-1, run_start_date=2024-07-04 03:47:02.286310+00:00, run_end_date=2024-07-04 03:47:04.026836+00:00, run_duration=1.740526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:47:00.159804+00:00, queued_by_job_id=2, pid=11082 2024-07-04T03:48:00.985900676Z [2024-07-04T03:48:00.985+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:48:01.006022779Z [2024-07-04T03:48:01.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:48:00+00:00, run_after=2024-07-04T03:49:00+00:00 2024-07-04T03:48:01.014722918Z [2024-07-04T03:48:01.014+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:48:01.083957472Z [2024-07-04T03:48:01.083+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:48:01.083989230Z 2024-07-04T03:48:01.083998492Z 2024-07-04T03:48:01.084002442Z 2024-07-04T03:48:01.084007766Z [2024-07-04T03:48:01.083+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:48:01.084099255Z [2024-07-04T03:48:01.083+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:48:01.084137285Z [2024-07-04T03:48:01.084+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:48:01.085029465Z [2024-07-04T03:48:01.084+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:48:01.085057831Z 2024-07-04T03:48:01.085064998Z 2024-07-04T03:48:01.085070783Z 2024-07-04T03:48:01.090392079Z [2024-07-04T03:48:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:48:01.090497247Z [2024-07-04T03:48:01.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:48:01.090769241Z [2024-07-04T03:48:01.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:48:01.090865887Z [2024-07-04T03:48:01.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:48:01.091172961Z [2024-07-04T03:48:01.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:48:01.091281370Z [2024-07-04T03:48:01.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:48:01.410518457Z [2024-07-04T03:48:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:46:00+00:00 exited with status queued for try_number 1 2024-07-04T03:48:01.410546869Z [2024-07-04T03:48:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:47:00+00:00 exited with status queued for try_number 1 2024-07-04T03:48:01.410550615Z [2024-07-04T03:48:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:47:00+00:00 exited with status queued for try_number 1 2024-07-04T03:48:01.425108177Z [2024-07-04T03:48:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b283af6-ce35-4667-b6de-bd1f270929df 2024-07-04T03:48:01.425224766Z [2024-07-04T03:48:01.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to 770780fc-d00e-4dbe-b720-e289bf8380f6 2024-07-04T03:48:01.425404897Z [2024-07-04T03:48:01.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to d87311ce-a279-441e-a523-73f8692c8f15 2024-07-04T03:48:03.029457117Z [2024-07-04T03:48:03.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:48:03.029700063Z [2024-07-04T03:48:03.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:46:00+00:00, run_id=scheduled__2024-07-04T03:46:00+00:00, run_start_date=2024-07-04 03:48:01.025924+00:00, run_end_date=2024-07-04 03:48:03.029307+00:00, run_duration=2.003383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:46:00+00:00, data_interval_end=2024-07-04 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:48:03.037957171Z [2024-07-04T03:48:03.037+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:48:00+00:00, run_after=2024-07-04T03:50:00+00:00 2024-07-04T03:48:03.106689154Z [2024-07-04T03:48:03.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:46:00+00:00 exited with status success for try_number 1 2024-07-04T03:48:03.115713324Z [2024-07-04T03:48:03.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:46:00+00:00, map_index=-1, run_start_date=2024-07-04 03:48:02.041428+00:00, run_end_date=2024-07-04 03:48:02.467131+00:00, run_duration=0.425703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:48:01.085998+00:00, queued_by_job_id=2, pid=11117 2024-07-04T03:48:05.812875422Z [2024-07-04T03:48:05.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:48:05.814026223Z [2024-07-04T03:48:05.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:47:00+00:00, run_id=scheduled__2024-07-04T03:47:00+00:00, run_start_date=2024-07-04 03:48:01.027324+00:00, run_end_date=2024-07-04 03:48:05.812664+00:00, run_duration=4.78534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:47:00+00:00, data_interval_end=2024-07-04 03:48:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:48:05.832485034Z [2024-07-04T03:48:05.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:48:00+00:00, run_after=2024-07-04T03:49:00+00:00 2024-07-04T03:48:05.842581288Z [2024-07-04T03:48:05.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:48:05.842963721Z [2024-07-04T03:48:05.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:47:00+00:00, run_id=scheduled__2024-07-04T03:47:00+00:00, run_start_date=2024-07-04 03:48:01.028449+00:00, run_end_date=2024-07-04 03:48:05.842372+00:00, run_duration=4.813923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:47:00+00:00, data_interval_end=2024-07-04 03:48:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:48:05.853544313Z [2024-07-04T03:48:05.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:48:00+00:00, run_after=2024-07-04T03:49:00+00:00 2024-07-04T03:48:05.895248435Z [2024-07-04T03:48:05.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:47:00+00:00 exited with status success for try_number 1 2024-07-04T03:48:05.895716274Z [2024-07-04T03:48:05.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:47:00+00:00 exited with status success for try_number 1 2024-07-04T03:48:05.905766504Z [2024-07-04T03:48:05.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:47:00+00:00, map_index=-1, run_start_date=2024-07-04 03:48:03.034456+00:00, run_end_date=2024-07-04 03:48:04.950252+00:00, run_duration=1.915796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:48:01.085998+00:00, queued_by_job_id=2, pid=11138 2024-07-04T03:48:05.906299993Z [2024-07-04T03:48:05.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:47:00+00:00, map_index=-1, run_start_date=2024-07-04 03:48:03.406781+00:00, run_end_date=2024-07-04 03:48:05.086854+00:00, run_duration=1.680073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:48:01.085998+00:00, queued_by_job_id=2, pid=11157 2024-07-04T03:49:00.872379891Z [2024-07-04T03:49:00.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:49:00+00:00, run_after=2024-07-04T03:50:00+00:00 2024-07-04T03:49:00.885755848Z [2024-07-04T03:49:00.885+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:49:00.941018340Z [2024-07-04T03:49:00.940+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:49:00.941051035Z 2024-07-04T03:49:00.941056776Z 2024-07-04T03:49:00.941131604Z [2024-07-04T03:49:00.940+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:49:00.941249125Z [2024-07-04T03:49:00.941+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:49:00.941931451Z [2024-07-04T03:49:00.941+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:49:00.941943691Z 2024-07-04T03:49:00.941947129Z 2024-07-04T03:49:00.945385770Z [2024-07-04T03:49:00.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:49:00.946912607Z [2024-07-04T03:49:00.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:49:00.947240891Z [2024-07-04T03:49:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:49:00.947453212Z [2024-07-04T03:49:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:49:01.236905217Z [2024-07-04T03:49:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:48:00+00:00 exited with status queued for try_number 1 2024-07-04T03:49:01.239209079Z [2024-07-04T03:49:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:48:00+00:00 exited with status queued for try_number 1 2024-07-04T03:49:01.248144543Z [2024-07-04T03:49:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 213555fc-a5ad-4be1-9c54-ce10ef256890 2024-07-04T03:49:01.248330423Z [2024-07-04T03:49:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to af4d6a0d-df7d-4639-b080-8b44781d6f8a 2024-07-04T03:49:04.934744229Z [2024-07-04T03:49:04.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:49:04.935158037Z [2024-07-04T03:49:04.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:48:00+00:00, run_id=scheduled__2024-07-04T03:48:00+00:00, run_start_date=2024-07-04 03:49:00.895940+00:00, run_end_date=2024-07-04 03:49:04.934466+00:00, run_duration=4.038526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:48:00+00:00, data_interval_end=2024-07-04 03:49:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:49:04.947625546Z [2024-07-04T03:49:04.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:49:00+00:00, run_after=2024-07-04T03:50:00+00:00 2024-07-04T03:49:04.958394538Z [2024-07-04T03:49:04.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:49:04.958561126Z [2024-07-04T03:49:04.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:48:00+00:00, run_id=scheduled__2024-07-04T03:48:00+00:00, run_start_date=2024-07-04 03:49:00.897308+00:00, run_end_date=2024-07-04 03:49:04.958066+00:00, run_duration=4.060758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:48:00+00:00, data_interval_end=2024-07-04 03:49:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:49:04.969114523Z [2024-07-04T03:49:04.968+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:49:00+00:00, run_after=2024-07-04T03:50:00+00:00 2024-07-04T03:49:05.020342567Z [2024-07-04T03:49:05.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:48:00+00:00 exited with status success for try_number 1 2024-07-04T03:49:05.021030086Z [2024-07-04T03:49:05.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:48:00+00:00 exited with status success for try_number 1 2024-07-04T03:49:05.034201585Z [2024-07-04T03:49:05.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:48:00+00:00, map_index=-1, run_start_date=2024-07-04 03:49:02.809663+00:00, run_end_date=2024-07-04 03:49:04.219989+00:00, run_duration=1.410326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:49:00.942491+00:00, queued_by_job_id=2, pid=11203 2024-07-04T03:49:05.034950339Z [2024-07-04T03:49:05.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:48:00+00:00, map_index=-1, run_start_date=2024-07-04 03:49:02.805890+00:00, run_end_date=2024-07-04 03:49:04.445105+00:00, run_duration=1.639215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:49:00.942491+00:00, queued_by_job_id=2, pid=11202 2024-07-04T03:50:00.613177998Z [2024-07-04T03:50:00.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:50:00+00:00, run_after=2024-07-04T03:51:00+00:00 2024-07-04T03:50:00.634776186Z [2024-07-04T03:50:00.634+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:50:00.656018798Z [2024-07-04T03:50:00.655+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:50:00.682845306Z [2024-07-04T03:50:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:50:00+00:00, run_after=2024-07-04T03:55:00+00:00 2024-07-04T03:50:00.845972996Z [2024-07-04T03:50:00.845+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T03:50:00.845990680Z 2024-07-04T03:50:00.845994583Z 2024-07-04T03:50:00.846018509Z 2024-07-04T03:50:00.846022366Z 2024-07-04T03:50:00.846814088Z [2024-07-04T03:50:00.846+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:50:00.847051485Z [2024-07-04T03:50:00.846+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:50:00.847244885Z [2024-07-04T03:50:00.847+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:50:00.847432182Z [2024-07-04T03:50:00.847+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:50:00.848547788Z [2024-07-04T03:50:00.848+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:50:00.848559726Z 2024-07-04T03:50:00.848578437Z 2024-07-04T03:50:00.848581972Z 2024-07-04T03:50:00.848592250Z 2024-07-04T03:50:00.853318201Z [2024-07-04T03:50:00.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:50:00.853578763Z [2024-07-04T03:50:00.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:50:00.853920410Z [2024-07-04T03:50:00.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:50:00.854132911Z [2024-07-04T03:50:00.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:50:00.854428579Z [2024-07-04T03:50:00.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:50:00.854626915Z [2024-07-04T03:50:00.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:50:00.854959259Z [2024-07-04T03:50:00.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:50:00.855183303Z [2024-07-04T03:50:00.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:50:01.493799116Z [2024-07-04T03:50:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status queued for try_number 1 2024-07-04T03:50:01.493854133Z [2024-07-04T03:50:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:48:00+00:00 exited with status queued for try_number 1 2024-07-04T03:50:01.494020440Z [2024-07-04T03:50:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:49:00+00:00 exited with status queued for try_number 1 2024-07-04T03:50:01.494138236Z [2024-07-04T03:50:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:49:00+00:00 exited with status queued for try_number 1 2024-07-04T03:50:01.507486307Z [2024-07-04T03:50:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1d42b2c-c0a1-4b1e-bebf-eb7cf4981b5d 2024-07-04T03:50:01.509331954Z [2024-07-04T03:50:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34b51c17-6d73-4df3-9117-72ce2cef84af 2024-07-04T03:50:01.509369958Z [2024-07-04T03:50:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 377decb1-7488-40d2-ab89-520e0a9f3c63 2024-07-04T03:50:01.511010889Z [2024-07-04T03:50:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to c651ed4f-9480-41b6-bfd8-6eee6806717a 2024-07-04T03:50:03.504917132Z [2024-07-04T03:50:03.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:50:03.505429548Z [2024-07-04T03:50:03.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:48:00+00:00, run_id=scheduled__2024-07-04T03:48:00+00:00, run_start_date=2024-07-04 03:50:00.707792+00:00, run_end_date=2024-07-04 03:50:03.504766+00:00, run_duration=2.796974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:48:00+00:00, data_interval_end=2024-07-04 03:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:50:03.513758029Z [2024-07-04T03:50:03.513+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:50:00+00:00, run_after=2024-07-04T03:52:00+00:00 2024-07-04T03:50:03.576495186Z [2024-07-04T03:50:03.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:48:00+00:00 exited with status success for try_number 1 2024-07-04T03:50:03.584312054Z [2024-07-04T03:50:03.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:48:00+00:00, map_index=-1, run_start_date=2024-07-04 03:50:02.234831+00:00, run_end_date=2024-07-04 03:50:02.767250+00:00, run_duration=0.532419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:50:00.849594+00:00, queued_by_job_id=2, pid=11239 2024-07-04T03:50:04.769055584Z [2024-07-04T03:50:04.767+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:50:04.769098974Z 2024-07-04T03:50:04.769106036Z [2024-07-04T03:50:04.768+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:50:04.773928221Z [2024-07-04T03:50:04.772+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:50:04.773949353Z 2024-07-04T03:50:04.785168514Z [2024-07-04T03:50:04.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:50:04.785428685Z [2024-07-04T03:50:04.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:50:04.841635502Z [2024-07-04T03:50:04.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status queued for try_number 1 2024-07-04T03:50:04.841776350Z [2024-07-04T03:50:04.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status success for try_number 1 2024-07-04T03:50:04.849122351Z [2024-07-04T03:50:04.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c115671-f132-481b-a48e-12f526b2c6fb 2024-07-04T03:50:04.849383019Z [2024-07-04T03:50:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:45:00+00:00, map_index=-1, run_start_date=2024-07-04 03:50:03.736902+00:00, run_end_date=2024-07-04 03:50:04.150859+00:00, run_duration=0.413957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:50:00.849594+00:00, queued_by_job_id=2, pid=11281 2024-07-04T03:50:05.292752817Z [2024-07-04T03:50:05.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:50:05.293078394Z [2024-07-04T03:50:05.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:49:00+00:00, run_id=scheduled__2024-07-04T03:49:00+00:00, run_start_date=2024-07-04 03:50:00.713396+00:00, run_end_date=2024-07-04 03:50:05.292770+00:00, run_duration=4.579374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:49:00+00:00, data_interval_end=2024-07-04 03:50:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:50:05.302581150Z [2024-07-04T03:50:05.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:50:00+00:00, run_after=2024-07-04T03:51:00+00:00 2024-07-04T03:50:06.426693758Z [2024-07-04T03:50:06.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:50:06.427041675Z [2024-07-04T03:50:06.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:49:00+00:00, run_id=scheduled__2024-07-04T03:49:00+00:00, run_start_date=2024-07-04 03:50:00.711923+00:00, run_end_date=2024-07-04 03:50:06.426602+00:00, run_duration=5.714679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:49:00+00:00, data_interval_end=2024-07-04 03:50:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:50:06.457071539Z [2024-07-04T03:50:06.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:50:00+00:00, run_after=2024-07-04T03:51:00+00:00 2024-07-04T03:50:06.515296477Z [2024-07-04T03:50:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:49:00+00:00 exited with status success for try_number 1 2024-07-04T03:50:06.515494788Z [2024-07-04T03:50:06.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:49:00+00:00 exited with status success for try_number 1 2024-07-04T03:50:06.522924478Z [2024-07-04T03:50:06.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:49:00+00:00, map_index=-1, run_start_date=2024-07-04 03:50:03.628243+00:00, run_end_date=2024-07-04 03:50:05.279954+00:00, run_duration=1.651711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:50:00.849594+00:00, queued_by_job_id=2, pid=11280 2024-07-04T03:50:06.523260260Z [2024-07-04T03:50:06.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:49:00+00:00, map_index=-1, run_start_date=2024-07-04 03:50:03.493739+00:00, run_end_date=2024-07-04 03:50:05.230722+00:00, run_duration=1.736983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:50:00.849594+00:00, queued_by_job_id=2, pid=11278 2024-07-04T03:50:07.603361417Z [2024-07-04T03:50:07.602+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:50:07.603426003Z 2024-07-04T03:50:07.603476440Z [2024-07-04T03:50:07.603+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:50:07.604344345Z [2024-07-04T03:50:07.604+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:50:07.604388651Z 2024-07-04T03:50:07.607855017Z [2024-07-04T03:50:07.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:50:07.608202380Z [2024-07-04T03:50:07.607+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:50:07.675349561Z [2024-07-04T03:50:07.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status queued for try_number 1 2024-07-04T03:50:07.676587275Z [2024-07-04T03:50:07.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status success for try_number 1 2024-07-04T03:50:07.682636125Z [2024-07-04T03:50:07.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35e5899f-c9c3-4a83-b406-fb5cae47a505 2024-07-04T03:50:07.682832899Z [2024-07-04T03:50:07.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:45:00+00:00, map_index=-1, run_start_date=2024-07-04 03:50:06.575810+00:00, run_end_date=2024-07-04 03:50:06.985371+00:00, run_duration=0.409561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:50:04.778288+00:00, queued_by_job_id=2, pid=11320 2024-07-04T03:50:09.854990733Z [2024-07-04T03:50:09.854+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:50:09.855015688Z 2024-07-04T03:50:09.855020014Z [2024-07-04T03:50:09.854+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:50:09.855491278Z [2024-07-04T03:50:09.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:50:09.855498115Z 2024-07-04T03:50:09.857885008Z [2024-07-04T03:50:09.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:50:09.857963263Z [2024-07-04T03:50:09.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:50:09.923203140Z [2024-07-04T03:50:09.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status queued for try_number 1 2024-07-04T03:50:09.923516153Z [2024-07-04T03:50:09.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status success for try_number 1 2024-07-04T03:50:09.929835275Z [2024-07-04T03:50:09.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45b7cedc-002b-4b53-bcf3-2a2cb1a42e84 2024-07-04T03:50:09.930279787Z [2024-07-04T03:50:09.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:45:00+00:00, map_index=0, run_start_date=2024-07-04 03:50:09.214388+00:00, run_end_date=2024-07-04 03:50:09.535397+00:00, run_duration=0.321009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:50:07.604840+00:00, queued_by_job_id=2, pid=11332 2024-07-04T03:50:12.496805632Z [2024-07-04T03:50:12.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:50:12.496907697Z [2024-07-04T03:50:12.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:45:00+00:00, run_id=scheduled__2024-07-04T03:45:00+00:00, run_start_date=2024-07-04 03:50:00.705876+00:00, run_end_date=2024-07-04 03:50:12.496628+00:00, run_duration=11.790752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:45:00+00:00, data_interval_end=2024-07-04 03:50:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:50:12.503096563Z [2024-07-04T03:50:12.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:50:00+00:00, run_after=2024-07-04T03:55:00+00:00 2024-07-04T03:50:12.535933546Z [2024-07-04T03:50:12.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:45:00+00:00 exited with status success for try_number 1 2024-07-04T03:50:12.541969349Z [2024-07-04T03:50:12.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:45:00+00:00, map_index=-1, run_start_date=2024-07-04 03:50:11.810163+00:00, run_end_date=2024-07-04 03:50:12.253249+00:00, run_duration=0.443086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:50:09.856036+00:00, queued_by_job_id=2, pid=11343 2024-07-04T03:51:00.584582046Z [2024-07-04T03:51:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:51:00+00:00, run_after=2024-07-04T03:52:00+00:00 2024-07-04T03:51:00.592708237Z [2024-07-04T03:51:00.592+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:51:00.654553100Z [2024-07-04T03:51:00.654+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:51:00.654589373Z 2024-07-04T03:51:00.654593137Z 2024-07-04T03:51:00.654692026Z [2024-07-04T03:51:00.654+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:51:00.654808518Z [2024-07-04T03:51:00.654+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:51:00.655480396Z [2024-07-04T03:51:00.655+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:51:00.655495636Z 2024-07-04T03:51:00.655499237Z 2024-07-04T03:51:00.658736040Z [2024-07-04T03:51:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:51:00.658909514Z [2024-07-04T03:51:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:51:00.659146293Z [2024-07-04T03:51:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:51:00.659307024Z [2024-07-04T03:51:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:51:00.948039572Z [2024-07-04T03:51:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status queued for try_number 1 2024-07-04T03:51:00.951082771Z [2024-07-04T03:51:00.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status queued for try_number 1 2024-07-04T03:51:00.965918425Z [2024-07-04T03:51:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22976a9a-b032-4d41-8892-faeecd1945d8 2024-07-04T03:51:00.966155304Z [2024-07-04T03:51:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to c28e70bd-cf05-4b6a-b271-7c7d8a655f29 2024-07-04T03:51:03.962566039Z [2024-07-04T03:51:03.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:51:03.962919937Z [2024-07-04T03:51:03.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:50:00+00:00, run_id=scheduled__2024-07-04T03:50:00+00:00, run_start_date=2024-07-04 03:51:00.610768+00:00, run_end_date=2024-07-04 03:51:03.962425+00:00, run_duration=3.351657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:50:00+00:00, data_interval_end=2024-07-04 03:51:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:51:03.977252510Z [2024-07-04T03:51:03.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:51:00+00:00, run_after=2024-07-04T03:52:00+00:00 2024-07-04T03:51:04.607551559Z [2024-07-04T03:51:04.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status success for try_number 1 2024-07-04T03:51:04.613016389Z [2024-07-04T03:51:04.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:50:00+00:00, map_index=-1, run_start_date=2024-07-04 03:51:02.544906+00:00, run_end_date=2024-07-04 03:51:03.880934+00:00, run_duration=1.336028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:51:00.656035+00:00, queued_by_job_id=2, pid=11379 2024-07-04T03:51:05.664722231Z [2024-07-04T03:51:05.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:51:05.665088186Z [2024-07-04T03:51:05.664+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:50:00+00:00, run_id=scheduled__2024-07-04T03:50:00+00:00, run_start_date=2024-07-04 03:51:00.612601+00:00, run_end_date=2024-07-04 03:51:05.664510+00:00, run_duration=5.051909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:50:00+00:00, data_interval_end=2024-07-04 03:51:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:51:05.676842988Z [2024-07-04T03:51:05.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:51:00+00:00, run_after=2024-07-04T03:52:00+00:00 2024-07-04T03:51:05.726662760Z [2024-07-04T03:51:05.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status success for try_number 1 2024-07-04T03:51:05.736380777Z [2024-07-04T03:51:05.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:50:00+00:00, map_index=-1, run_start_date=2024-07-04 03:51:02.540934+00:00, run_end_date=2024-07-04 03:51:04.564556+00:00, run_duration=2.023622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:51:00.656035+00:00, queued_by_job_id=2, pid=11380 2024-07-04T03:51:22.975942701Z [2024-07-04T03:51:22.975+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:52:00.425378764Z [2024-07-04T03:52:00.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:52:00+00:00, run_after=2024-07-04T03:53:00+00:00 2024-07-04T03:52:00.443472687Z [2024-07-04T03:52:00.443+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:52:00.454978915Z [2024-07-04T03:52:00.454+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:52:00.567269019Z [2024-07-04T03:52:00.566+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:52:00.567304148Z 2024-07-04T03:52:00.567316672Z 2024-07-04T03:52:00.567320520Z 2024-07-04T03:52:00.567330957Z [2024-07-04T03:52:00.567+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:52:00.567354390Z [2024-07-04T03:52:00.567+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:52:00.567433260Z [2024-07-04T03:52:00.567+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:52:00.567995941Z [2024-07-04T03:52:00.567+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:52:00.568010082Z 2024-07-04T03:52:00.568014428Z 2024-07-04T03:52:00.568018220Z 2024-07-04T03:52:00.571479220Z [2024-07-04T03:52:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:52:00.571562818Z [2024-07-04T03:52:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:52:00.571742696Z [2024-07-04T03:52:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:52:00.571842890Z [2024-07-04T03:52:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:52:00.571991727Z [2024-07-04T03:52:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:52:00.572059395Z [2024-07-04T03:52:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:52:01.145248408Z [2024-07-04T03:52:01.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status queued for try_number 1 2024-07-04T03:52:01.145638254Z [2024-07-04T03:52:01.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:51:00+00:00 exited with status queued for try_number 1 2024-07-04T03:52:01.145931352Z [2024-07-04T03:52:01.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:51:00+00:00 exited with status queued for try_number 1 2024-07-04T03:52:01.158535945Z [2024-07-04T03:52:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e5bffaf-c282-43e3-9ff1-fe708f50a3af 2024-07-04T03:52:01.158929695Z [2024-07-04T03:52:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55697f8a-b5ad-48ab-b022-0701b447c727 2024-07-04T03:52:01.159134666Z [2024-07-04T03:52:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f2f1b9f-fc50-4520-9177-56a144458b5c 2024-07-04T03:52:02.546267145Z [2024-07-04T03:52:02.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:52:02.546671802Z [2024-07-04T03:52:02.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:50:00+00:00, run_id=scheduled__2024-07-04T03:50:00+00:00, run_start_date=2024-07-04 03:52:00.475766+00:00, run_end_date=2024-07-04 03:52:02.546261+00:00, run_duration=2.070495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:50:00+00:00, data_interval_end=2024-07-04 03:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:52:02.554305826Z [2024-07-04T03:52:02.553+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:52:00+00:00, run_after=2024-07-04T03:54:00+00:00 2024-07-04T03:52:02.618269759Z [2024-07-04T03:52:02.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status success for try_number 1 2024-07-04T03:52:02.628660694Z [2024-07-04T03:52:02.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:50:00+00:00, map_index=-1, run_start_date=2024-07-04 03:52:01.529463+00:00, run_end_date=2024-07-04 03:52:01.998253+00:00, run_duration=0.46879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:52:00.568672+00:00, queued_by_job_id=2, pid=11415 2024-07-04T03:52:04.364937656Z [2024-07-04T03:52:04.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:52:04.365527643Z [2024-07-04T03:52:04.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:51:00+00:00, run_id=scheduled__2024-07-04T03:51:00+00:00, run_start_date=2024-07-04 03:52:00.477387+00:00, run_end_date=2024-07-04 03:52:04.365063+00:00, run_duration=3.887676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:51:00+00:00, data_interval_end=2024-07-04 03:52:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:52:04.380348536Z [2024-07-04T03:52:04.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:52:00+00:00, run_after=2024-07-04T03:53:00+00:00 2024-07-04T03:52:04.430785893Z [2024-07-04T03:52:04.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:51:00+00:00 exited with status success for try_number 1 2024-07-04T03:52:04.439142648Z [2024-07-04T03:52:04.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:51:00+00:00, map_index=-1, run_start_date=2024-07-04 03:52:02.640280+00:00, run_end_date=2024-07-04 03:52:03.948745+00:00, run_duration=1.308465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:52:00.568672+00:00, queued_by_job_id=2, pid=11436 2024-07-04T03:52:06.014561933Z [2024-07-04T03:52:06.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:52:06.015134619Z [2024-07-04T03:52:06.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:51:00+00:00, run_id=scheduled__2024-07-04T03:51:00+00:00, run_start_date=2024-07-04 03:52:00.478493+00:00, run_end_date=2024-07-04 03:52:06.014598+00:00, run_duration=5.536105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:51:00+00:00, data_interval_end=2024-07-04 03:52:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:52:06.029798849Z [2024-07-04T03:52:06.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:52:00+00:00, run_after=2024-07-04T03:53:00+00:00 2024-07-04T03:52:06.078952187Z [2024-07-04T03:52:06.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:51:00+00:00 exited with status success for try_number 1 2024-07-04T03:52:06.088893320Z [2024-07-04T03:52:06.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:51:00+00:00, map_index=-1, run_start_date=2024-07-04 03:52:02.969456+00:00, run_end_date=2024-07-04 03:52:05.529118+00:00, run_duration=2.559662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:52:00.568672+00:00, queued_by_job_id=2, pid=11455 2024-07-04T03:53:00.249013726Z [2024-07-04T03:53:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:53:00+00:00, run_after=2024-07-04T03:54:00+00:00 2024-07-04T03:53:00.261943853Z [2024-07-04T03:53:00.261+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:53:00.373135426Z [2024-07-04T03:53:00.372+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:53:00.373178242Z 2024-07-04T03:53:00.373190794Z 2024-07-04T03:53:00.373628498Z [2024-07-04T03:53:00.373+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:53:00.374471881Z [2024-07-04T03:53:00.374+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:53:00.375642242Z [2024-07-04T03:53:00.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:53:00.375677648Z 2024-07-04T03:53:00.375682512Z 2024-07-04T03:53:00.386852963Z [2024-07-04T03:53:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:53:00.387431218Z [2024-07-04T03:53:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:53:00.388109728Z [2024-07-04T03:53:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:53:00.389528959Z [2024-07-04T03:53:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:53:00.591197960Z [2024-07-04T03:53:00.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:52:00+00:00 exited with status queued for try_number 1 2024-07-04T03:53:00.592657827Z [2024-07-04T03:53:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:52:00+00:00 exited with status queued for try_number 1 2024-07-04T03:53:00.606638619Z [2024-07-04T03:53:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05f29f20-eb7c-423a-a275-43fd72c650a9 2024-07-04T03:53:00.607126644Z [2024-07-04T03:53:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to e18a62c7-2bb0-4176-b9d9-03fa1d34a090 2024-07-04T03:53:04.831821259Z [2024-07-04T03:53:04.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:53:04.832343956Z [2024-07-04T03:53:04.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:52:00+00:00, run_id=scheduled__2024-07-04T03:52:00+00:00, run_start_date=2024-07-04 03:53:00.284753+00:00, run_end_date=2024-07-04 03:53:04.831989+00:00, run_duration=4.547236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:52:00+00:00, data_interval_end=2024-07-04 03:53:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:53:04.842147177Z [2024-07-04T03:53:04.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:53:00+00:00, run_after=2024-07-04T03:54:00+00:00 2024-07-04T03:53:04.889159727Z [2024-07-04T03:53:04.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:52:00+00:00 exited with status success for try_number 1 2024-07-04T03:53:04.897400957Z [2024-07-04T03:53:04.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:52:00+00:00, map_index=-1, run_start_date=2024-07-04 03:53:02.501395+00:00, run_end_date=2024-07-04 03:53:04.377887+00:00, run_duration=1.876492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:53:00.377771+00:00, queued_by_job_id=2, pid=11501 2024-07-04T03:53:05.942579763Z [2024-07-04T03:53:05.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:53:05.943102517Z [2024-07-04T03:53:05.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:52:00+00:00, run_id=scheduled__2024-07-04T03:52:00+00:00, run_start_date=2024-07-04 03:53:00.287148+00:00, run_end_date=2024-07-04 03:53:05.942698+00:00, run_duration=5.65555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:52:00+00:00, data_interval_end=2024-07-04 03:53:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:53:05.953718528Z [2024-07-04T03:53:05.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:53:00+00:00, run_after=2024-07-04T03:54:00+00:00 2024-07-04T03:53:05.989245763Z [2024-07-04T03:53:05.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:52:00+00:00 exited with status success for try_number 1 2024-07-04T03:53:05.997763115Z [2024-07-04T03:53:05.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:52:00+00:00, map_index=-1, run_start_date=2024-07-04 03:53:02.433667+00:00, run_end_date=2024-07-04 03:53:04.902357+00:00, run_duration=2.46869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:53:00.377771+00:00, queued_by_job_id=2, pid=11500 2024-07-04T03:54:00.203881159Z [2024-07-04T03:54:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:54:00+00:00, run_after=2024-07-04T03:55:00+00:00 2024-07-04T03:54:00.227018010Z [2024-07-04T03:54:00.226+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:54:00.246315941Z [2024-07-04T03:54:00.244+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:54:00.343372884Z [2024-07-04T03:54:00.343+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:54:00.343400786Z 2024-07-04T03:54:00.343419416Z 2024-07-04T03:54:00.343422748Z 2024-07-04T03:54:00.344062833Z [2024-07-04T03:54:00.343+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:54:00.344214582Z [2024-07-04T03:54:00.343+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:54:00.344772158Z [2024-07-04T03:54:00.344+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:54:00.345434879Z [2024-07-04T03:54:00.345+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:54:00.345446585Z 2024-07-04T03:54:00.345450430Z 2024-07-04T03:54:00.345454358Z 2024-07-04T03:54:00.349320434Z [2024-07-04T03:54:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:54:00.349578856Z [2024-07-04T03:54:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:54:00.349876957Z [2024-07-04T03:54:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:54:00.350050845Z [2024-07-04T03:54:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:54:00.350362206Z [2024-07-04T03:54:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:54:00.350543851Z [2024-07-04T03:54:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:54:00.737934260Z [2024-07-04T03:54:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:52:00+00:00 exited with status queued for try_number 1 2024-07-04T03:54:00.738019187Z [2024-07-04T03:54:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:53:00+00:00 exited with status queued for try_number 1 2024-07-04T03:54:00.738169489Z [2024-07-04T03:54:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:53:00+00:00 exited with status queued for try_number 1 2024-07-04T03:54:00.751520810Z [2024-07-04T03:54:00.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3835e176-784e-42f8-8f1b-e98dd5a04a28 2024-07-04T03:54:00.752989169Z [2024-07-04T03:54:00.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46b99757-2dae-48f0-92fc-0574d2b344f0 2024-07-04T03:54:00.753238481Z [2024-07-04T03:54:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2cb7f8d-fa33-4d96-9d8b-d23eabd437bc 2024-07-04T03:54:03.085798596Z [2024-07-04T03:54:03.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:54:03.086345436Z [2024-07-04T03:54:03.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:52:00+00:00, run_id=scheduled__2024-07-04T03:52:00+00:00, run_start_date=2024-07-04 03:54:00.265196+00:00, run_end_date=2024-07-04 03:54:03.085657+00:00, run_duration=2.820461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:52:00+00:00, data_interval_end=2024-07-04 03:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:54:03.093702256Z [2024-07-04T03:54:03.093+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:54:00+00:00, run_after=2024-07-04T03:56:00+00:00 2024-07-04T03:54:03.141818838Z [2024-07-04T03:54:03.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:52:00+00:00 exited with status success for try_number 1 2024-07-04T03:54:03.146664228Z [2024-07-04T03:54:03.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:52:00+00:00, map_index=-1, run_start_date=2024-07-04 03:54:01.597323+00:00, run_end_date=2024-07-04 03:54:02.163462+00:00, run_duration=0.566139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:54:00.346464+00:00, queued_by_job_id=2, pid=11536 2024-07-04T03:54:05.209203911Z [2024-07-04T03:54:05.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:54:05.209516741Z [2024-07-04T03:54:05.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:53:00+00:00, run_id=scheduled__2024-07-04T03:53:00+00:00, run_start_date=2024-07-04 03:54:00.268355+00:00, run_end_date=2024-07-04 03:54:05.208958+00:00, run_duration=4.940603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:53:00+00:00, data_interval_end=2024-07-04 03:54:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:54:05.225994142Z [2024-07-04T03:54:05.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:54:00+00:00, run_after=2024-07-04T03:55:00+00:00 2024-07-04T03:54:05.234257175Z [2024-07-04T03:54:05.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:54:05.234428963Z [2024-07-04T03:54:05.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:53:00+00:00, run_id=scheduled__2024-07-04T03:53:00+00:00, run_start_date=2024-07-04 03:54:00.271338+00:00, run_end_date=2024-07-04 03:54:05.234096+00:00, run_duration=4.962758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:53:00+00:00, data_interval_end=2024-07-04 03:54:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:54:05.243318673Z [2024-07-04T03:54:05.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:54:00+00:00, run_after=2024-07-04T03:55:00+00:00 2024-07-04T03:54:05.283325089Z [2024-07-04T03:54:05.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:53:00+00:00 exited with status success for try_number 1 2024-07-04T03:54:05.283375786Z [2024-07-04T03:54:05.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:53:00+00:00 exited with status success for try_number 1 2024-07-04T03:54:05.294606797Z [2024-07-04T03:54:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:53:00+00:00, map_index=-1, run_start_date=2024-07-04 03:54:02.720402+00:00, run_end_date=2024-07-04 03:54:04.261062+00:00, run_duration=1.54066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:54:00.346464+00:00, queued_by_job_id=2, pid=11566 2024-07-04T03:54:05.294758364Z [2024-07-04T03:54:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:53:00+00:00, map_index=-1, run_start_date=2024-07-04 03:54:02.834613+00:00, run_end_date=2024-07-04 03:54:04.993083+00:00, run_duration=2.15847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:54:00.346464+00:00, queued_by_job_id=2, pid=11567 2024-07-04T03:55:00.070765734Z [2024-07-04T03:55:00.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:55:00.089322049Z [2024-07-04T03:55:00.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:55:00+00:00, run_after=2024-07-04T03:56:00+00:00 2024-07-04T03:55:00.102419202Z [2024-07-04T03:55:00.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:55:00+00:00, run_after=2024-07-04T04:00:00+00:00 2024-07-04T03:55:00.172124454Z [2024-07-04T03:55:00.171+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:55:00.172154003Z 2024-07-04T03:55:00.172172651Z 2024-07-04T03:55:00.172175931Z 2024-07-04T03:55:00.172282805Z [2024-07-04T03:55:00.172+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:55:00.172386176Z [2024-07-04T03:55:00.172+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:55:00.172524692Z [2024-07-04T03:55:00.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:55:00.173175482Z [2024-07-04T03:55:00.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:55:00.173192541Z 2024-07-04T03:55:00.173198148Z 2024-07-04T03:55:00.173203689Z 2024-07-04T03:55:00.176350512Z [2024-07-04T03:55:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T03:55:00.176568607Z [2024-07-04T03:55:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:55:00.176867909Z [2024-07-04T03:55:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:55:00.177000836Z [2024-07-04T03:55:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:55:00.177229260Z [2024-07-04T03:55:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:55:00.177408816Z [2024-07-04T03:55:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:55:00.522309398Z [2024-07-04T03:55:00.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status queued for try_number 1 2024-07-04T03:55:00.522955012Z [2024-07-04T03:55:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:54:00+00:00 exited with status queued for try_number 1 2024-07-04T03:55:00.523227241Z [2024-07-04T03:55:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:54:00+00:00 exited with status queued for try_number 1 2024-07-04T03:55:00.545045001Z [2024-07-04T03:55:00.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2eea6c5-2f67-4679-a72b-272747a7f33a 2024-07-04T03:55:00.545964552Z [2024-07-04T03:55:00.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e923b18-36d1-4be9-80a2-3b04ebe3d68b 2024-07-04T03:55:00.546246131Z [2024-07-04T03:55:00.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73810c6a-2a86-4a80-89db-cdca2593af32 2024-07-04T03:55:03.957457290Z [2024-07-04T03:55:03.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:55:03.957927673Z [2024-07-04T03:55:03.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:54:00+00:00, run_id=scheduled__2024-07-04T03:54:00+00:00, run_start_date=2024-07-04 03:55:00.115569+00:00, run_end_date=2024-07-04 03:55:03.957341+00:00, run_duration=3.841772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:54:00+00:00, data_interval_end=2024-07-04 03:55:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:55:03.970033033Z [2024-07-04T03:55:03.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:55:00+00:00, run_after=2024-07-04T03:56:00+00:00 2024-07-04T03:55:03.999143053Z [2024-07-04T03:55:03.998+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:55:03.999187672Z 2024-07-04T03:55:03.999198415Z [2024-07-04T03:55:03.998+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:55:03.999871456Z [2024-07-04T03:55:03.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:55:03.999904131Z 2024-07-04T03:55:04.004335855Z [2024-07-04T03:55:04.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T03:55:04.004749204Z [2024-07-04T03:55:04.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:55:04.061887162Z [2024-07-04T03:55:04.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status queued for try_number 1 2024-07-04T03:55:04.061972260Z [2024-07-04T03:55:04.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status success for try_number 1 2024-07-04T03:55:04.062108854Z [2024-07-04T03:55:04.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:54:00+00:00 exited with status success for try_number 1 2024-07-04T03:55:04.071295097Z [2024-07-04T03:55:04.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:50:00+00:00, map_index=-1, run_start_date=2024-07-04 03:55:02.707393+00:00, run_end_date=2024-07-04 03:55:03.094687+00:00, run_duration=0.387294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:55:00.173901+00:00, queued_by_job_id=2, pid=11645 2024-07-04T03:55:04.071825995Z [2024-07-04T03:55:04.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:54:00+00:00, map_index=-1, run_start_date=2024-07-04 03:55:02.290212+00:00, run_end_date=2024-07-04 03:55:03.586441+00:00, run_duration=1.296229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:55:00.173901+00:00, queued_by_job_id=2, pid=11623 2024-07-04T03:55:04.072181383Z [2024-07-04T03:55:04.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63219cbf-0e55-46c4-af7f-a8acade3e494 2024-07-04T03:55:04.163272719Z [2024-07-04T03:55:04.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:55:04.163794045Z [2024-07-04T03:55:04.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:54:00+00:00, run_id=scheduled__2024-07-04T03:54:00+00:00, run_start_date=2024-07-04 03:55:00.116693+00:00, run_end_date=2024-07-04 03:55:04.163176+00:00, run_duration=4.046483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:54:00+00:00, data_interval_end=2024-07-04 03:55:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:55:04.179832867Z [2024-07-04T03:55:04.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:55:00+00:00, run_after=2024-07-04T03:56:00+00:00 2024-07-04T03:55:04.580758631Z [2024-07-04T03:55:04.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:54:00+00:00 exited with status success for try_number 1 2024-07-04T03:55:04.597291493Z [2024-07-04T03:55:04.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:54:00+00:00, map_index=-1, run_start_date=2024-07-04 03:55:02.409856+00:00, run_end_date=2024-07-04 03:55:04.105235+00:00, run_duration=1.695379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:55:00.173901+00:00, queued_by_job_id=2, pid=11624 2024-07-04T03:55:06.763003293Z [2024-07-04T03:55:06.762+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:55:06.763047338Z 2024-07-04T03:55:06.763210797Z [2024-07-04T03:55:06.762+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:55:06.763901034Z [2024-07-04T03:55:06.763+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:55:06.763917126Z 2024-07-04T03:55:06.766226747Z [2024-07-04T03:55:06.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T03:55:06.766428054Z [2024-07-04T03:55:06.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:55:06.831058596Z [2024-07-04T03:55:06.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status queued for try_number 1 2024-07-04T03:55:06.831161992Z [2024-07-04T03:55:06.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status success for try_number 1 2024-07-04T03:55:06.838543484Z [2024-07-04T03:55:06.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bb55274-b23e-4b10-b30f-805c790bd666 2024-07-04T03:55:06.838818178Z [2024-07-04T03:55:06.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:50:00+00:00, map_index=-1, run_start_date=2024-07-04 03:55:05.715678+00:00, run_end_date=2024-07-04 03:55:06.120749+00:00, run_duration=0.405071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:55:04.000275+00:00, queued_by_job_id=2, pid=11672 2024-07-04T03:55:09.166219379Z [2024-07-04T03:55:09.165+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T03:55:09.166251503Z 2024-07-04T03:55:09.166359005Z [2024-07-04T03:55:09.166+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:55:09.167525155Z [2024-07-04T03:55:09.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:55:09.167547975Z 2024-07-04T03:55:09.171225524Z [2024-07-04T03:55:09.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:55:09.171424322Z [2024-07-04T03:55:09.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:55:09.259719484Z [2024-07-04T03:55:09.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status queued for try_number 1 2024-07-04T03:55:09.260029791Z [2024-07-04T03:55:09.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status success for try_number 1 2024-07-04T03:55:09.277360404Z [2024-07-04T03:55:09.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d8ff105-4b8f-4fe3-ac08-76924113632d 2024-07-04T03:55:09.277535808Z [2024-07-04T03:55:09.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:50:00+00:00, map_index=0, run_start_date=2024-07-04 03:55:08.400477+00:00, run_end_date=2024-07-04 03:55:08.746420+00:00, run_duration=0.345943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:55:06.764306+00:00, queued_by_job_id=2, pid=11684 2024-07-04T03:55:11.530897077Z [2024-07-04T03:55:11.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:55:11.531397831Z [2024-07-04T03:55:11.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:50:00+00:00, run_id=scheduled__2024-07-04T03:50:00+00:00, run_start_date=2024-07-04 03:55:00.114161+00:00, run_end_date=2024-07-04 03:55:11.530769+00:00, run_duration=11.416608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:50:00+00:00, data_interval_end=2024-07-04 03:55:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T03:55:11.539293359Z [2024-07-04T03:55:11.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:55:00+00:00, run_after=2024-07-04T04:00:00+00:00 2024-07-04T03:55:11.577787925Z [2024-07-04T03:55:11.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:50:00+00:00 exited with status success for try_number 1 2024-07-04T03:55:11.584792806Z [2024-07-04T03:55:11.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:50:00+00:00, map_index=-1, run_start_date=2024-07-04 03:55:10.923146+00:00, run_end_date=2024-07-04 03:55:11.324528+00:00, run_duration=0.401382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:55:09.168144+00:00, queued_by_job_id=2, pid=11696 2024-07-04T03:56:00.053184443Z [2024-07-04T03:56:00.052+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:56:00.074761034Z [2024-07-04T03:56:00.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:56:00+00:00, run_after=2024-07-04T03:57:00+00:00 2024-07-04T03:56:00.086803560Z [2024-07-04T03:56:00.086+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:56:00.147692977Z [2024-07-04T03:56:00.147+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:56:00.147735812Z 2024-07-04T03:56:00.147746759Z 2024-07-04T03:56:00.147755743Z 2024-07-04T03:56:00.147921128Z [2024-07-04T03:56:00.147+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:56:00.147935938Z [2024-07-04T03:56:00.147+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:56:00.147944825Z [2024-07-04T03:56:00.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:56:00.148499782Z [2024-07-04T03:56:00.148+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:56:00.148517907Z 2024-07-04T03:56:00.148527131Z 2024-07-04T03:56:00.148535800Z 2024-07-04T03:56:00.151487974Z [2024-07-04T03:56:00.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:56:00.151695028Z [2024-07-04T03:56:00.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:56:00.151824385Z [2024-07-04T03:56:00.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:56:00.152059395Z [2024-07-04T03:56:00.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:56:00.152381267Z [2024-07-04T03:56:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:56:00.152538580Z [2024-07-04T03:56:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:56:00.538934202Z [2024-07-04T03:56:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:54:00+00:00 exited with status queued for try_number 1 2024-07-04T03:56:00.541644056Z [2024-07-04T03:56:00.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status queued for try_number 1 2024-07-04T03:56:00.541749643Z [2024-07-04T03:56:00.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status queued for try_number 1 2024-07-04T03:56:00.550271292Z [2024-07-04T03:56:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47f20fdd-0043-4f25-a101-8b9d2a202b30 2024-07-04T03:56:00.550906146Z [2024-07-04T03:56:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5f8f040-0695-4e31-ac7c-dba6d2681142 2024-07-04T03:56:00.551073778Z [2024-07-04T03:56:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a53c1e1-7b77-44bb-8531-323855e3d107 2024-07-04T03:56:02.984986497Z [2024-07-04T03:56:02.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:56:02.985503156Z [2024-07-04T03:56:02.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:54:00+00:00, run_id=scheduled__2024-07-04T03:54:00+00:00, run_start_date=2024-07-04 03:56:00.097943+00:00, run_end_date=2024-07-04 03:56:02.984893+00:00, run_duration=2.88695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:54:00+00:00, data_interval_end=2024-07-04 03:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:56:02.994666061Z [2024-07-04T03:56:02.994+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:56:00+00:00, run_after=2024-07-04T03:58:00+00:00 2024-07-04T03:56:03.064782722Z [2024-07-04T03:56:03.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:54:00+00:00 exited with status success for try_number 1 2024-07-04T03:56:03.075008035Z [2024-07-04T03:56:03.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:54:00+00:00, map_index=-1, run_start_date=2024-07-04 03:56:01.344740+00:00, run_end_date=2024-07-04 03:56:01.726803+00:00, run_duration=0.382063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:56:00.149184+00:00, queued_by_job_id=2, pid=11714 2024-07-04T03:56:04.135253852Z [2024-07-04T03:56:04.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:56:04.135743500Z [2024-07-04T03:56:04.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:55:00+00:00, run_id=scheduled__2024-07-04T03:55:00+00:00, run_start_date=2024-07-04 03:56:00.099064+00:00, run_end_date=2024-07-04 03:56:04.135084+00:00, run_duration=4.03602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:55:00+00:00, data_interval_end=2024-07-04 03:56:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:56:04.147054539Z [2024-07-04T03:56:04.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:56:00+00:00, run_after=2024-07-04T03:57:00+00:00 2024-07-04T03:56:04.155939645Z [2024-07-04T03:56:04.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:56:04.156237614Z [2024-07-04T03:56:04.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:55:00+00:00, run_id=scheduled__2024-07-04T03:55:00+00:00, run_start_date=2024-07-04 03:56:00.100018+00:00, run_end_date=2024-07-04 03:56:04.155806+00:00, run_duration=4.055788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:55:00+00:00, data_interval_end=2024-07-04 03:56:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:56:04.166533081Z [2024-07-04T03:56:04.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:56:00+00:00, run_after=2024-07-04T03:57:00+00:00 2024-07-04T03:56:04.202738690Z [2024-07-04T03:56:04.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status success for try_number 1 2024-07-04T03:56:04.204001295Z [2024-07-04T03:56:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status success for try_number 1 2024-07-04T03:56:04.232142552Z [2024-07-04T03:56:04.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:55:00+00:00, map_index=-1, run_start_date=2024-07-04 03:56:02.157342+00:00, run_end_date=2024-07-04 03:56:03.905801+00:00, run_duration=1.748459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:56:00.149184+00:00, queued_by_job_id=2, pid=11743 2024-07-04T03:56:04.232475556Z [2024-07-04T03:56:04.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:55:00+00:00, map_index=-1, run_start_date=2024-07-04 03:56:02.290020+00:00, run_end_date=2024-07-04 03:56:03.596332+00:00, run_duration=1.306312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:56:00.149184+00:00, queued_by_job_id=2, pid=11744 2024-07-04T03:56:23.059508051Z [2024-07-04T03:56:23.058+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T03:57:00.667615933Z [2024-07-04T03:57:00.666+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:57:00+00:00, run_after=2024-07-04T03:58:00+00:00 2024-07-04T03:57:00.678189252Z [2024-07-04T03:57:00.677+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:57:00.747429202Z [2024-07-04T03:57:00.746+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:57:00.747480797Z 2024-07-04T03:57:00.747488995Z 2024-07-04T03:57:00.747856050Z [2024-07-04T03:57:00.747+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:57:00.748041767Z [2024-07-04T03:57:00.747+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:57:00.748885633Z [2024-07-04T03:57:00.748+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:57:00.748914258Z 2024-07-04T03:57:00.748920728Z 2024-07-04T03:57:00.753555652Z [2024-07-04T03:57:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:57:00.754518730Z [2024-07-04T03:57:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:57:00.754854573Z [2024-07-04T03:57:00.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:57:00.755060392Z [2024-07-04T03:57:00.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:57:00.994693607Z [2024-07-04T03:57:00.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:56:00+00:00 exited with status queued for try_number 1 2024-07-04T03:57:00.994851462Z [2024-07-04T03:57:00.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:56:00+00:00 exited with status queued for try_number 1 2024-07-04T03:57:01.005094550Z [2024-07-04T03:57:01.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to e485f3d8-98aa-462c-9530-4d73ff79461c 2024-07-04T03:57:01.005178992Z [2024-07-04T03:57:01.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39638ff6-3655-4b96-bbe8-ca50ebaccebd 2024-07-04T03:57:05.104934553Z [2024-07-04T03:57:05.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:57:05.105031074Z [2024-07-04T03:57:05.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:56:00+00:00, run_id=scheduled__2024-07-04T03:56:00+00:00, run_start_date=2024-07-04 03:57:00.689633+00:00, run_end_date=2024-07-04 03:57:05.104524+00:00, run_duration=4.414891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:56:00+00:00, data_interval_end=2024-07-04 03:57:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:57:05.116765875Z [2024-07-04T03:57:05.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:57:00+00:00, run_after=2024-07-04T03:58:00+00:00 2024-07-04T03:57:05.163075391Z [2024-07-04T03:57:05.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:56:00+00:00 exited with status success for try_number 1 2024-07-04T03:57:05.169893202Z [2024-07-04T03:57:05.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:56:00+00:00, map_index=-1, run_start_date=2024-07-04 03:57:02.766292+00:00, run_end_date=2024-07-04 03:57:04.630391+00:00, run_duration=1.864099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:57:00.749590+00:00, queued_by_job_id=2, pid=11798 2024-07-04T03:57:05.412111166Z [2024-07-04T03:57:05.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:57:05.413166577Z [2024-07-04T03:57:05.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:56:00+00:00, run_id=scheduled__2024-07-04T03:56:00+00:00, run_start_date=2024-07-04 03:57:00.691392+00:00, run_end_date=2024-07-04 03:57:05.412565+00:00, run_duration=4.721173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:56:00+00:00, data_interval_end=2024-07-04 03:57:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:57:05.427390611Z [2024-07-04T03:57:05.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:57:00+00:00, run_after=2024-07-04T03:58:00+00:00 2024-07-04T03:57:05.462732493Z [2024-07-04T03:57:05.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:56:00+00:00 exited with status success for try_number 1 2024-07-04T03:57:05.469479262Z [2024-07-04T03:57:05.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:56:00+00:00, map_index=-1, run_start_date=2024-07-04 03:57:02.780656+00:00, run_end_date=2024-07-04 03:57:05.150076+00:00, run_duration=2.36942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:57:00.749590+00:00, queued_by_job_id=2, pid=11799 2024-07-04T03:58:00.676616416Z [2024-07-04T03:58:00.675+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:58:00.692398438Z [2024-07-04T03:58:00.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:58:00+00:00, run_after=2024-07-04T03:59:00+00:00 2024-07-04T03:58:00.702649376Z [2024-07-04T03:58:00.702+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:58:00.793841757Z [2024-07-04T03:58:00.793+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T03:58:00.793876604Z 2024-07-04T03:58:00.793880877Z 2024-07-04T03:58:00.793884381Z 2024-07-04T03:58:00.793982105Z [2024-07-04T03:58:00.793+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T03:58:00.794098410Z [2024-07-04T03:58:00.793+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:58:00.794210781Z [2024-07-04T03:58:00.794+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:58:00.795010602Z [2024-07-04T03:58:00.794+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:58:00.795026964Z 2024-07-04T03:58:00.795030765Z 2024-07-04T03:58:00.795033969Z 2024-07-04T03:58:00.800578560Z [2024-07-04T03:58:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:58:00.800814526Z [2024-07-04T03:58:00.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:58:00.801087495Z [2024-07-04T03:58:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:58:00.801216045Z [2024-07-04T03:58:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:58:00.801429763Z [2024-07-04T03:58:00.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:58:00.801556573Z [2024-07-04T03:58:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:58:01.183027978Z [2024-07-04T03:58:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:56:00+00:00 exited with status queued for try_number 1 2024-07-04T03:58:01.185607919Z [2024-07-04T03:58:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:57:00+00:00 exited with status queued for try_number 1 2024-07-04T03:58:01.185730548Z [2024-07-04T03:58:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:57:00+00:00 exited with status queued for try_number 1 2024-07-04T03:58:01.202448688Z [2024-07-04T03:58:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to e77aa6c3-ef0a-4200-8731-bc20117afe36 2024-07-04T03:58:01.204027190Z [2024-07-04T03:58:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f7ce515-68c6-4986-859a-31c2e5ad70cd 2024-07-04T03:58:01.204194846Z [2024-07-04T03:58:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c550653-95bd-4759-9891-601d83eeb79b 2024-07-04T03:58:02.364242088Z [2024-07-04T03:58:02.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:58:02.365210622Z [2024-07-04T03:58:02.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:56:00+00:00, run_id=scheduled__2024-07-04T03:56:00+00:00, run_start_date=2024-07-04 03:58:00.717692+00:00, run_end_date=2024-07-04 03:58:02.364522+00:00, run_duration=1.64683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:56:00+00:00, data_interval_end=2024-07-04 03:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T03:58:02.373686099Z [2024-07-04T03:58:02.373+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T03:58:00+00:00, run_after=2024-07-04T04:00:00+00:00 2024-07-04T03:58:02.436774094Z [2024-07-04T03:58:02.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:56:00+00:00 exited with status success for try_number 1 2024-07-04T03:58:02.449082588Z [2024-07-04T03:58:02.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:56:00+00:00, map_index=-1, run_start_date=2024-07-04 03:58:01.705500+00:00, run_end_date=2024-07-04 03:58:02.089357+00:00, run_duration=0.383857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:58:00.795953+00:00, queued_by_job_id=2, pid=11834 2024-07-04T03:58:04.634155264Z [2024-07-04T03:58:04.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:58:04.634739694Z [2024-07-04T03:58:04.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:57:00+00:00, run_id=scheduled__2024-07-04T03:57:00+00:00, run_start_date=2024-07-04 03:58:00.719460+00:00, run_end_date=2024-07-04 03:58:04.634109+00:00, run_duration=3.914649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:57:00+00:00, data_interval_end=2024-07-04 03:58:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:58:04.647020929Z [2024-07-04T03:58:04.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:58:00+00:00, run_after=2024-07-04T03:59:00+00:00 2024-07-04T03:58:04.684148894Z [2024-07-04T03:58:04.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:57:00+00:00 exited with status success for try_number 1 2024-07-04T03:58:04.684259546Z [2024-07-04T03:58:04.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:57:00+00:00 exited with status success for try_number 1 2024-07-04T03:58:04.692993701Z [2024-07-04T03:58:04.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:57:00+00:00, map_index=-1, run_start_date=2024-07-04 03:58:02.764174+00:00, run_end_date=2024-07-04 03:58:04.098282+00:00, run_duration=1.334108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:58:00.795953+00:00, queued_by_job_id=2, pid=11863 2024-07-04T03:58:04.693105037Z [2024-07-04T03:58:04.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:57:00+00:00, map_index=-1, run_start_date=2024-07-04 03:58:02.816464+00:00, run_end_date=2024-07-04 03:58:04.525457+00:00, run_duration=1.708993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:58:00.795953+00:00, queued_by_job_id=2, pid=11864 2024-07-04T03:58:05.748941915Z [2024-07-04T03:58:05.748+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:58:05.749416681Z [2024-07-04T03:58:05.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:57:00+00:00, run_id=scheduled__2024-07-04T03:57:00+00:00, run_start_date=2024-07-04 03:58:00.720764+00:00, run_end_date=2024-07-04 03:58:05.748744+00:00, run_duration=5.02798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:57:00+00:00, data_interval_end=2024-07-04 03:58:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:58:05.762661757Z [2024-07-04T03:58:05.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:58:00+00:00, run_after=2024-07-04T03:59:00+00:00 2024-07-04T03:59:00.415873779Z [2024-07-04T03:59:00.415+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T03:59:00.454066967Z [2024-07-04T03:59:00.453+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:59:00+00:00, run_after=2024-07-04T04:00:00+00:00 2024-07-04T03:59:00.508876960Z [2024-07-04T03:59:00.508+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T03:59:00.508904277Z 2024-07-04T03:59:00.508913856Z 2024-07-04T03:59:00.509682516Z [2024-07-04T03:59:00.509+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:59:00.509911414Z [2024-07-04T03:59:00.509+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T03:59:00.510570441Z [2024-07-04T03:59:00.510+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T03:59:00.510582834Z 2024-07-04T03:59:00.510586400Z 2024-07-04T03:59:00.513775360Z [2024-07-04T03:59:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:59:00.514026298Z [2024-07-04T03:59:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:59:00.514345288Z [2024-07-04T03:59:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T03:59:00.514520111Z [2024-07-04T03:59:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:59:00.875924188Z [2024-07-04T03:59:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:58:00+00:00 exited with status queued for try_number 1 2024-07-04T03:59:00.875961303Z [2024-07-04T03:59:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:58:00+00:00 exited with status queued for try_number 1 2024-07-04T03:59:00.892067820Z [2024-07-04T03:59:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0cf39cd-86e9-44a5-ab97-7f5d0e298d29 2024-07-04T03:59:00.892105175Z [2024-07-04T03:59:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to 601f2fbf-4c97-4723-ab37-8db08f94de9a 2024-07-04T03:59:04.434932223Z [2024-07-04T03:59:04.434+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:59:04.435150583Z [2024-07-04T03:59:04.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:58:00+00:00, run_id=scheduled__2024-07-04T03:58:00+00:00, run_start_date=2024-07-04 03:59:00.468316+00:00, run_end_date=2024-07-04 03:59:04.434689+00:00, run_duration=3.966373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:58:00+00:00, data_interval_end=2024-07-04 03:59:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T03:59:04.447098982Z [2024-07-04T03:59:04.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:59:00+00:00, run_after=2024-07-04T04:00:00+00:00 2024-07-04T03:59:04.501480007Z [2024-07-04T03:59:04.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:58:00+00:00 exited with status success for try_number 1 2024-07-04T03:59:04.508540333Z [2024-07-04T03:59:04.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:58:00+00:00, map_index=-1, run_start_date=2024-07-04 03:59:02.813569+00:00, run_end_date=2024-07-04 03:59:04.227154+00:00, run_duration=1.413585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:59:00.511290+00:00, queued_by_job_id=2, pid=11919 2024-07-04T03:59:05.561852030Z [2024-07-04T03:59:05.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T03:59:05.562419211Z [2024-07-04T03:59:05.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:58:00+00:00, run_id=scheduled__2024-07-04T03:58:00+00:00, run_start_date=2024-07-04 03:59:00.469744+00:00, run_end_date=2024-07-04 03:59:05.561892+00:00, run_duration=5.092148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:58:00+00:00, data_interval_end=2024-07-04 03:59:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T03:59:05.575925161Z [2024-07-04T03:59:05.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T03:59:00+00:00, run_after=2024-07-04T04:00:00+00:00 2024-07-04T03:59:05.619256534Z [2024-07-04T03:59:05.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:58:00+00:00 exited with status success for try_number 1 2024-07-04T03:59:05.630109552Z [2024-07-04T03:59:05.629+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:58:00+00:00, map_index=-1, run_start_date=2024-07-04 03:59:02.808041+00:00, run_end_date=2024-07-04 03:59:04.534834+00:00, run_duration=1.726793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 03:59:00.511290+00:00, queued_by_job_id=2, pid=11918 2024-07-04T04:00:00.348230398Z [2024-07-04T04:00:00.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:00:00+00:00, run_after=2024-07-04T04:05:00+00:00 2024-07-04T04:00:00.366358714Z [2024-07-04T04:00:00.366+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:00:00+00:00, run_after=2024-07-04T04:01:00+00:00 2024-07-04T04:00:00.379551646Z [2024-07-04T04:00:00.379+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:00:00.398778121Z [2024-07-04T04:00:00.398+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:00:00.532978657Z [2024-07-04T04:00:00.532+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-07-04T04:00:00.533009242Z 2024-07-04T04:00:00.533014413Z 2024-07-04T04:00:00.533019616Z 2024-07-04T04:00:00.533023049Z 2024-07-04T04:00:00.533233816Z [2024-07-04T04:00:00.533+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:00:00.533399102Z [2024-07-04T04:00:00.533+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T04:00:00.533541756Z [2024-07-04T04:00:00.533+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:00:00.533699934Z [2024-07-04T04:00:00.533+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:00:00.538432989Z [2024-07-04T04:00:00.534+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:00:00.538450986Z 2024-07-04T04:00:00.538470284Z 2024-07-04T04:00:00.538473811Z 2024-07-04T04:00:00.538476988Z 2024-07-04T04:00:00.545246001Z [2024-07-04T04:00:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T04:00:00.545626944Z [2024-07-04T04:00:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:00:00.545870796Z [2024-07-04T04:00:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:00:00.545956772Z [2024-07-04T04:00:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:00:00.546142559Z [2024-07-04T04:00:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:00:00.546206208Z [2024-07-04T04:00:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:00:00.546363841Z [2024-07-04T04:00:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:00:00.546462460Z [2024-07-04T04:00:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:00:00.979645742Z [2024-07-04T04:00:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status queued for try_number 1 2024-07-04T04:00:00.982005528Z [2024-07-04T04:00:00.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:58:00+00:00 exited with status queued for try_number 1 2024-07-04T04:00:00.982246281Z [2024-07-04T04:00:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:59:00+00:00 exited with status queued for try_number 1 2024-07-04T04:00:00.982409798Z [2024-07-04T04:00:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:59:00+00:00 exited with status queued for try_number 1 2024-07-04T04:00:00.997988633Z [2024-07-04T04:00:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70efd17d-6d7f-49d7-9cd8-a2af39bf64b6 2024-07-04T04:00:00.998286671Z [2024-07-04T04:00:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03e1459b-a543-4e59-9473-f5a07c138fe6 2024-07-04T04:00:00.998500808Z [2024-07-04T04:00:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05392701-d281-4694-b2ce-b1779553e2fd 2024-07-04T04:00:00.998707223Z [2024-07-04T04:00:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28178bde-70ed-4b3d-a7fb-dd4f3871e244 2024-07-04T04:00:02.283613062Z [2024-07-04T04:00:02.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:00:02.284092421Z [2024-07-04T04:00:02.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 03:58:00+00:00, run_id=scheduled__2024-07-04T03:58:00+00:00, run_start_date=2024-07-04 04:00:00.418221+00:00, run_end_date=2024-07-04 04:00:02.283526+00:00, run_duration=1.865305, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:58:00+00:00, data_interval_end=2024-07-04 04:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T04:00:02.294655321Z [2024-07-04T04:00:02.294+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T04:00:00+00:00, run_after=2024-07-04T04:02:00+00:00 2024-07-04T04:00:02.359354563Z [2024-07-04T04:00:02.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T03:58:00+00:00 exited with status success for try_number 1 2024-07-04T04:00:02.370052416Z [2024-07-04T04:00:02.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T03:58:00+00:00, map_index=-1, run_start_date=2024-07-04 04:00:01.524416+00:00, run_end_date=2024-07-04 04:00:02.019258+00:00, run_duration=0.494842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:00:00.539468+00:00, queued_by_job_id=2, pid=11954 2024-07-04T04:00:03.445151621Z [2024-07-04T04:00:03.444+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T04:00:03.445199429Z 2024-07-04T04:00:03.445210197Z [2024-07-04T04:00:03.444+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:00:03.445733707Z [2024-07-04T04:00:03.445+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:00:03.445758681Z 2024-07-04T04:00:03.448268312Z [2024-07-04T04:00:03.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T04:00:03.448942009Z [2024-07-04T04:00:03.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:00:03.509882017Z [2024-07-04T04:00:03.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status queued for try_number 1 2024-07-04T04:00:03.509935511Z [2024-07-04T04:00:03.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status success for try_number 1 2024-07-04T04:00:03.515500755Z [2024-07-04T04:00:03.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58a1b54e-6cfc-40ac-ab1d-90e2da7cedb8 2024-07-04T04:00:03.515640084Z [2024-07-04T04:00:03.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T03:55:00+00:00, map_index=-1, run_start_date=2024-07-04 04:00:02.829636+00:00, run_end_date=2024-07-04 04:00:03.206248+00:00, run_duration=0.376612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:00:00.539468+00:00, queued_by_job_id=2, pid=11992 2024-07-04T04:00:04.356941028Z [2024-07-04T04:00:04.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:00:04.357526798Z [2024-07-04T04:00:04.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:59:00+00:00, run_id=scheduled__2024-07-04T03:59:00+00:00, run_start_date=2024-07-04 04:00:00.419690+00:00, run_end_date=2024-07-04 04:00:04.357019+00:00, run_duration=3.937329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:59:00+00:00, data_interval_end=2024-07-04 04:00:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T04:00:04.375915582Z [2024-07-04T04:00:04.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:00:00+00:00, run_after=2024-07-04T04:01:00+00:00 2024-07-04T04:00:05.511496840Z [2024-07-04T04:00:05.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:00:05.511909467Z [2024-07-04T04:00:05.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:59:00+00:00, run_id=scheduled__2024-07-04T03:59:00+00:00, run_start_date=2024-07-04 04:00:00.421025+00:00, run_end_date=2024-07-04 04:00:05.511591+00:00, run_duration=5.090566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:59:00+00:00, data_interval_end=2024-07-04 04:00:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T04:00:05.521471110Z [2024-07-04T04:00:05.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:00:00+00:00, run_after=2024-07-04T04:01:00+00:00 2024-07-04T04:00:05.573737789Z [2024-07-04T04:00:05.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:59:00+00:00 exited with status success for try_number 1 2024-07-04T04:00:05.576387092Z [2024-07-04T04:00:05.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T03:59:00+00:00 exited with status success for try_number 1 2024-07-04T04:00:05.586328261Z [2024-07-04T04:00:05.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:59:00+00:00, map_index=-1, run_start_date=2024-07-04 04:00:03.053043+00:00, run_end_date=2024-07-04 04:00:04.307687+00:00, run_duration=1.254644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:00:00.539468+00:00, queued_by_job_id=2, pid=11996 2024-07-04T04:00:05.587277336Z [2024-07-04T04:00:05.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T03:59:00+00:00, map_index=-1, run_start_date=2024-07-04 04:00:02.942825+00:00, run_end_date=2024-07-04 04:00:04.666656+00:00, run_duration=1.723831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:00:00.539468+00:00, queued_by_job_id=2, pid=11995 2024-07-04T04:00:06.588611635Z [2024-07-04T04:00:06.588+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T04:00:06.588651354Z 2024-07-04T04:00:06.588827972Z [2024-07-04T04:00:06.588+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:00:06.589438629Z [2024-07-04T04:00:06.589+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:00:06.589454423Z 2024-07-04T04:00:06.592117049Z [2024-07-04T04:00:06.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T03:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T04:00:06.592237158Z [2024-07-04T04:00:06.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T04:00:06.654579988Z [2024-07-04T04:00:06.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status queued for try_number 1 2024-07-04T04:00:06.654764360Z [2024-07-04T04:00:06.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status success for try_number 1 2024-07-04T04:00:06.661546279Z [2024-07-04T04:00:06.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0d291cd-975b-4835-8812-d5318bf15928 2024-07-04T04:00:06.661781579Z [2024-07-04T04:00:06.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T03:55:00+00:00, map_index=-1, run_start_date=2024-07-04 04:00:05.432638+00:00, run_end_date=2024-07-04 04:00:05.781084+00:00, run_duration=0.348446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:00:03.446095+00:00, queued_by_job_id=2, pid=12035 2024-07-04T04:00:09.204193813Z [2024-07-04T04:00:09.203+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T04:00:09.204222849Z 2024-07-04T04:00:09.204656041Z [2024-07-04T04:00:09.204+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:00:09.205778046Z [2024-07-04T04:00:09.205+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:00:09.205797634Z 2024-07-04T04:00:09.211133514Z [2024-07-04T04:00:09.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:00:09.211392606Z [2024-07-04T04:00:09.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:00:09.321611898Z [2024-07-04T04:00:09.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status queued for try_number 1 2024-07-04T04:00:09.321896904Z [2024-07-04T04:00:09.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status success for try_number 1 2024-07-04T04:00:09.331422669Z [2024-07-04T04:00:09.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cddfa24-b532-4356-bd7e-9c54337b2316 2024-07-04T04:00:09.331852667Z [2024-07-04T04:00:09.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T03:55:00+00:00, map_index=0, run_start_date=2024-07-04 04:00:08.213665+00:00, run_end_date=2024-07-04 04:00:08.567923+00:00, run_duration=0.354258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:00:06.589874+00:00, queued_by_job_id=2, pid=12047 2024-07-04T04:00:11.661605099Z [2024-07-04T04:00:11.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:00:11.661821588Z [2024-07-04T04:00:11.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 03:55:00+00:00, run_id=scheduled__2024-07-04T03:55:00+00:00, run_start_date=2024-07-04 04:00:00.413592+00:00, run_end_date=2024-07-04 04:00:11.661339+00:00, run_duration=11.247747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 03:55:00+00:00, data_interval_end=2024-07-04 04:00:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T04:00:11.667360709Z [2024-07-04T04:00:11.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:00:00+00:00, run_after=2024-07-04T04:05:00+00:00 2024-07-04T04:00:11.698693689Z [2024-07-04T04:00:11.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T03:55:00+00:00 exited with status success for try_number 1 2024-07-04T04:00:11.712741808Z [2024-07-04T04:00:11.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T03:55:00+00:00, map_index=-1, run_start_date=2024-07-04 04:00:10.975099+00:00, run_end_date=2024-07-04 04:00:11.341652+00:00, run_duration=0.366553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:00:09.208125+00:00, queued_by_job_id=2, pid=12059 2024-07-04T04:01:00.150666598Z [2024-07-04T04:01:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:01:00+00:00, run_after=2024-07-04T04:02:00+00:00 2024-07-04T04:01:00.165637777Z [2024-07-04T04:01:00.165+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:01:00.225013851Z [2024-07-04T04:01:00.224+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T04:01:00.225040627Z 2024-07-04T04:01:00.225044484Z 2024-07-04T04:01:00.225048127Z [2024-07-04T04:01:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:01:00.225084982Z [2024-07-04T04:01:00.224+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:01:00.225834442Z [2024-07-04T04:01:00.225+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:01:00.225865089Z 2024-07-04T04:01:00.225869031Z 2024-07-04T04:01:00.228685274Z [2024-07-04T04:01:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:01:00.228963944Z [2024-07-04T04:01:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:01:00.229364924Z [2024-07-04T04:01:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:01:00.229545392Z [2024-07-04T04:01:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:01:00.502943618Z [2024-07-04T04:01:00.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status queued for try_number 1 2024-07-04T04:01:00.503087582Z [2024-07-04T04:01:00.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status queued for try_number 1 2024-07-04T04:01:00.527810078Z [2024-07-04T04:01:00.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b08c123-b89c-4a8b-8a99-35e05caf1410 2024-07-04T04:01:00.527842815Z [2024-07-04T04:01:00.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3f09131-ff49-4966-bdc6-aa57f0de10c7 2024-07-04T04:01:03.868340523Z [2024-07-04T04:01:03.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:01:03.868956273Z [2024-07-04T04:01:03.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:00:00+00:00, run_id=scheduled__2024-07-04T04:00:00+00:00, run_start_date=2024-07-04 04:01:00.178159+00:00, run_end_date=2024-07-04 04:01:03.868582+00:00, run_duration=3.690423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:00:00+00:00, data_interval_end=2024-07-04 04:01:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T04:01:03.880276778Z [2024-07-04T04:01:03.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:01:00+00:00, run_after=2024-07-04T04:02:00+00:00 2024-07-04T04:01:03.923690059Z [2024-07-04T04:01:03.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status success for try_number 1 2024-07-04T04:01:03.930837177Z [2024-07-04T04:01:03.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:00:00+00:00, map_index=-1, run_start_date=2024-07-04 04:01:02.286490+00:00, run_end_date=2024-07-04 04:01:03.727120+00:00, run_duration=1.44063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:01:00.226428+00:00, queued_by_job_id=2, pid=12095 2024-07-04T04:01:04.977475176Z [2024-07-04T04:01:04.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:01:04.977572574Z [2024-07-04T04:01:04.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:00:00+00:00, run_id=scheduled__2024-07-04T04:00:00+00:00, run_start_date=2024-07-04 04:01:00.179611+00:00, run_end_date=2024-07-04 04:01:04.977268+00:00, run_duration=4.797657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:00:00+00:00, data_interval_end=2024-07-04 04:01:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T04:01:04.990429836Z [2024-07-04T04:01:04.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:01:00+00:00, run_after=2024-07-04T04:02:00+00:00 2024-07-04T04:01:05.040529466Z [2024-07-04T04:01:05.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status success for try_number 1 2024-07-04T04:01:05.048674536Z [2024-07-04T04:01:05.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:00:00+00:00, map_index=-1, run_start_date=2024-07-04 04:01:02.425870+00:00, run_end_date=2024-07-04 04:01:04.280114+00:00, run_duration=1.854244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:01:00.226428+00:00, queued_by_job_id=2, pid=12096 2024-07-04T04:01:23.124048858Z [2024-07-04T04:01:23.123+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T04:02:00.495927915Z [2024-07-04T04:02:00.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:02:00+00:00, run_after=2024-07-04T04:03:00+00:00 2024-07-04T04:02:00.503746182Z [2024-07-04T04:02:00.503+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:02:00.513257949Z [2024-07-04T04:02:00.512+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:02:00.606185162Z [2024-07-04T04:02:00.605+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T04:02:00.606226646Z 2024-07-04T04:02:00.606237381Z 2024-07-04T04:02:00.606246254Z 2024-07-04T04:02:00.606271671Z [2024-07-04T04:02:00.606+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T04:02:00.606306814Z [2024-07-04T04:02:00.606+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:02:00.606430363Z [2024-07-04T04:02:00.606+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:02:00.607731696Z [2024-07-04T04:02:00.607+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:02:00.607768663Z 2024-07-04T04:02:00.607778551Z 2024-07-04T04:02:00.607787708Z 2024-07-04T04:02:00.613376438Z [2024-07-04T04:02:00.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:02:00.613424633Z [2024-07-04T04:02:00.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:02:00.613616319Z [2024-07-04T04:02:00.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:02:00.613670531Z [2024-07-04T04:02:00.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:02:00.613868585Z [2024-07-04T04:02:00.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:02:00.613890547Z [2024-07-04T04:02:00.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:02:01.030138062Z [2024-07-04T04:02:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status queued for try_number 1 2024-07-04T04:02:01.030174601Z [2024-07-04T04:02:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:01:00+00:00 exited with status queued for try_number 1 2024-07-04T04:02:01.030214548Z [2024-07-04T04:02:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:01:00+00:00 exited with status queued for try_number 1 2024-07-04T04:02:01.048269586Z [2024-07-04T04:02:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbd1a035-5c94-4d22-ac7d-acea690e9217 2024-07-04T04:02:01.048319470Z [2024-07-04T04:02:01.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to f20ec157-5277-477f-91c1-89db9c76c76e 2024-07-04T04:02:01.048443089Z [2024-07-04T04:02:01.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e95d966-03eb-4def-bd90-7ea24c6d794e 2024-07-04T04:02:02.570402572Z [2024-07-04T04:02:02.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:02:02.571517255Z [2024-07-04T04:02:02.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 04:00:00+00:00, run_id=scheduled__2024-07-04T04:00:00+00:00, run_start_date=2024-07-04 04:02:00.524451+00:00, run_end_date=2024-07-04 04:02:02.570950+00:00, run_duration=2.046499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:00:00+00:00, data_interval_end=2024-07-04 04:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T04:02:02.584917452Z [2024-07-04T04:02:02.584+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T04:02:00+00:00, run_after=2024-07-04T04:04:00+00:00 2024-07-04T04:02:02.657654324Z [2024-07-04T04:02:02.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status success for try_number 1 2024-07-04T04:02:02.664564650Z [2024-07-04T04:02:02.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T04:00:00+00:00, map_index=-1, run_start_date=2024-07-04 04:02:01.543594+00:00, run_end_date=2024-07-04 04:02:01.943533+00:00, run_duration=0.399939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:02:00.608956+00:00, queued_by_job_id=2, pid=12131 2024-07-04T04:02:04.819619323Z [2024-07-04T04:02:04.818+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:02:04.819980887Z [2024-07-04T04:02:04.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:01:00+00:00, run_id=scheduled__2024-07-04T04:01:00+00:00, run_start_date=2024-07-04 04:02:00.525918+00:00, run_end_date=2024-07-04 04:02:04.819551+00:00, run_duration=4.293633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:01:00+00:00, data_interval_end=2024-07-04 04:02:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T04:02:04.830800328Z [2024-07-04T04:02:04.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:02:00+00:00, run_after=2024-07-04T04:03:00+00:00 2024-07-04T04:02:04.840248861Z [2024-07-04T04:02:04.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:02:04.840742938Z [2024-07-04T04:02:04.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:01:00+00:00, run_id=scheduled__2024-07-04T04:01:00+00:00, run_start_date=2024-07-04 04:02:00.527041+00:00, run_end_date=2024-07-04 04:02:04.840180+00:00, run_duration=4.313139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:01:00+00:00, data_interval_end=2024-07-04 04:02:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T04:02:04.850132832Z [2024-07-04T04:02:04.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:02:00+00:00, run_after=2024-07-04T04:03:00+00:00 2024-07-04T04:02:04.896152208Z [2024-07-04T04:02:04.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:01:00+00:00 exited with status success for try_number 1 2024-07-04T04:02:04.896530927Z [2024-07-04T04:02:04.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:01:00+00:00 exited with status success for try_number 1 2024-07-04T04:02:04.905592784Z [2024-07-04T04:02:04.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:01:00+00:00, map_index=-1, run_start_date=2024-07-04 04:02:02.696009+00:00, run_end_date=2024-07-04 04:02:04.029341+00:00, run_duration=1.333332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:02:00.608956+00:00, queued_by_job_id=2, pid=12160 2024-07-04T04:02:04.906043991Z [2024-07-04T04:02:04.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:01:00+00:00, map_index=-1, run_start_date=2024-07-04 04:02:02.714075+00:00, run_end_date=2024-07-04 04:02:04.373098+00:00, run_duration=1.659023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:02:00.608956+00:00, queued_by_job_id=2, pid=12161 2024-07-04T04:03:00.971020854Z [2024-07-04T04:03:00.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:03:00+00:00, run_after=2024-07-04T04:04:00+00:00 2024-07-04T04:03:00.977362952Z [2024-07-04T04:03:00.977+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:03:01.044623125Z [2024-07-04T04:03:01.044+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T04:03:01.044680182Z 2024-07-04T04:03:01.044690937Z 2024-07-04T04:03:01.044848750Z [2024-07-04T04:03:01.044+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:03:01.045232437Z [2024-07-04T04:03:01.044+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:03:01.046178267Z [2024-07-04T04:03:01.045+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:03:01.046209618Z 2024-07-04T04:03:01.046214048Z 2024-07-04T04:03:01.049481233Z [2024-07-04T04:03:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:03:01.049717883Z [2024-07-04T04:03:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:03:01.050121441Z [2024-07-04T04:03:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:03:01.050580333Z [2024-07-04T04:03:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:03:01.207150490Z [2024-07-04T04:03:01.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:02:00+00:00 exited with status queued for try_number 1 2024-07-04T04:03:01.207295778Z [2024-07-04T04:03:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:02:00+00:00 exited with status queued for try_number 1 2024-07-04T04:03:01.216661721Z [2024-07-04T04:03:01.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4cd862c-92a9-4b59-a8fe-bf2813f93351 2024-07-04T04:03:01.217369970Z [2024-07-04T04:03:01.217+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7af89c66-c535-4fbf-84fc-fefc30833d15 2024-07-04T04:03:05.636443108Z [2024-07-04T04:03:05.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:03:05.637018004Z [2024-07-04T04:03:05.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:02:00+00:00, run_id=scheduled__2024-07-04T04:02:00+00:00, run_start_date=2024-07-04 04:03:00.986196+00:00, run_end_date=2024-07-04 04:03:05.636395+00:00, run_duration=4.650199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:02:00+00:00, data_interval_end=2024-07-04 04:03:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T04:03:05.648340632Z [2024-07-04T04:03:05.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:03:00+00:00, run_after=2024-07-04T04:04:00+00:00 2024-07-04T04:03:05.706678366Z [2024-07-04T04:03:05.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:02:00+00:00 exited with status success for try_number 1 2024-07-04T04:03:05.713544681Z [2024-07-04T04:03:05.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:02:00+00:00, map_index=-1, run_start_date=2024-07-04 04:03:02.789678+00:00, run_end_date=2024-07-04 04:03:05.019012+00:00, run_duration=2.229334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:03:01.047119+00:00, queued_by_job_id=2, pid=12217 2024-07-04T04:03:06.788121519Z [2024-07-04T04:03:06.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:03:06.788510742Z [2024-07-04T04:03:06.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:02:00+00:00, run_id=scheduled__2024-07-04T04:02:00+00:00, run_start_date=2024-07-04 04:03:00.987359+00:00, run_end_date=2024-07-04 04:03:06.787875+00:00, run_duration=5.800516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:02:00+00:00, data_interval_end=2024-07-04 04:03:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T04:03:06.802965815Z [2024-07-04T04:03:06.802+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:03:00+00:00, run_after=2024-07-04T04:04:00+00:00 2024-07-04T04:03:06.839050826Z [2024-07-04T04:03:06.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:02:00+00:00 exited with status success for try_number 1 2024-07-04T04:03:06.844635719Z [2024-07-04T04:03:06.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:02:00+00:00, map_index=-1, run_start_date=2024-07-04 04:03:02.773932+00:00, run_end_date=2024-07-04 04:03:05.965226+00:00, run_duration=3.191294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:03:01.047119+00:00, queued_by_job_id=2, pid=12216 2024-07-04T04:04:00.207525471Z [2024-07-04T04:04:00.206+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:04:00.223547668Z [2024-07-04T04:04:00.223+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:04:00+00:00, run_after=2024-07-04T04:05:00+00:00 2024-07-04T04:04:00.232127677Z [2024-07-04T04:04:00.231+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:04:00.299664797Z [2024-07-04T04:04:00.299+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T04:04:00.299697240Z 2024-07-04T04:04:00.299718900Z 2024-07-04T04:04:00.299723139Z 2024-07-04T04:04:00.299773385Z [2024-07-04T04:04:00.299+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T04:04:00.300079085Z [2024-07-04T04:04:00.299+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:04:00.300273592Z [2024-07-04T04:04:00.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:04:00.301087021Z [2024-07-04T04:04:00.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:04:00.301101137Z 2024-07-04T04:04:00.301105177Z 2024-07-04T04:04:00.301108468Z 2024-07-04T04:04:00.306011577Z [2024-07-04T04:04:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:04:00.306242921Z [2024-07-04T04:04:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:04:00.306527227Z [2024-07-04T04:04:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:04:00.306648272Z [2024-07-04T04:04:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:04:00.307032922Z [2024-07-04T04:04:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:04:00.307056132Z [2024-07-04T04:04:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:04:00.633279655Z [2024-07-04T04:04:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T04:02:00+00:00 exited with status queued for try_number 1 2024-07-04T04:04:00.633388573Z [2024-07-04T04:04:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:03:00+00:00 exited with status queued for try_number 1 2024-07-04T04:04:00.635398296Z [2024-07-04T04:04:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:03:00+00:00 exited with status queued for try_number 1 2024-07-04T04:04:00.651527037Z [2024-07-04T04:04:00.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d09c072-f8e8-41cd-b821-7cc7173e563f 2024-07-04T04:04:00.651661043Z [2024-07-04T04:04:00.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f5a4a1e-5122-4883-b0d1-81929aa4934f 2024-07-04T04:04:00.651840027Z [2024-07-04T04:04:00.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bedf98c-8e77-469b-821b-086a78c42d57 2024-07-04T04:04:03.061095968Z [2024-07-04T04:04:03.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:04:03.061419842Z [2024-07-04T04:04:03.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 04:02:00+00:00, run_id=scheduled__2024-07-04T04:02:00+00:00, run_start_date=2024-07-04 04:04:00.243032+00:00, run_end_date=2024-07-04 04:04:03.061066+00:00, run_duration=2.818034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:02:00+00:00, data_interval_end=2024-07-04 04:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T04:04:03.068577073Z [2024-07-04T04:04:03.068+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T04:04:00+00:00, run_after=2024-07-04T04:06:00+00:00 2024-07-04T04:04:03.130835985Z [2024-07-04T04:04:03.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T04:02:00+00:00 exited with status success for try_number 1 2024-07-04T04:04:03.140364285Z [2024-07-04T04:04:03.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T04:02:00+00:00, map_index=-1, run_start_date=2024-07-04 04:04:01.506270+00:00, run_end_date=2024-07-04 04:04:02.030004+00:00, run_duration=0.523734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:04:00.301864+00:00, queued_by_job_id=2, pid=12253 2024-07-04T04:04:05.309209035Z [2024-07-04T04:04:05.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:04:05.309377578Z [2024-07-04T04:04:05.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:03:00+00:00, run_id=scheduled__2024-07-04T04:03:00+00:00, run_start_date=2024-07-04 04:04:00.245836+00:00, run_end_date=2024-07-04 04:04:05.309013+00:00, run_duration=5.063177, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:03:00+00:00, data_interval_end=2024-07-04 04:04:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T04:04:05.317484180Z [2024-07-04T04:04:05.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:04:00+00:00, run_after=2024-07-04T04:05:00+00:00 2024-07-04T04:04:05.355367999Z [2024-07-04T04:04:05.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:03:00+00:00 exited with status success for try_number 1 2024-07-04T04:04:05.360791750Z [2024-07-04T04:04:05.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:03:00+00:00, map_index=-1, run_start_date=2024-07-04 04:04:02.824140+00:00, run_end_date=2024-07-04 04:04:04.428017+00:00, run_duration=1.603877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:04:00.301864+00:00, queued_by_job_id=2, pid=12274 2024-07-04T04:04:06.408792006Z [2024-07-04T04:04:06.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:04:06.409296601Z [2024-07-04T04:04:06.408+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:03:00+00:00, run_id=scheduled__2024-07-04T04:03:00+00:00, run_start_date=2024-07-04 04:04:00.244663+00:00, run_end_date=2024-07-04 04:04:06.408676+00:00, run_duration=6.164013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:03:00+00:00, data_interval_end=2024-07-04 04:04:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T04:04:06.424554423Z [2024-07-04T04:04:06.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:04:00+00:00, run_after=2024-07-04T04:05:00+00:00 2024-07-04T04:04:06.475163561Z [2024-07-04T04:04:06.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:03:00+00:00 exited with status success for try_number 1 2024-07-04T04:04:06.483353591Z [2024-07-04T04:04:06.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:03:00+00:00, map_index=-1, run_start_date=2024-07-04 04:04:03.116624+00:00, run_end_date=2024-07-04 04:04:05.952583+00:00, run_duration=2.835959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:04:00.301864+00:00, queued_by_job_id=2, pid=12293 2024-07-04T04:05:00.981417223Z [2024-07-04T04:05:00.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:05:00+00:00, run_after=2024-07-04T04:06:00+00:00 2024-07-04T04:05:01.000229881Z [2024-07-04T04:05:00.999+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:05:01.020169561Z [2024-07-04T04:05:01.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:05:00+00:00, run_after=2024-07-04T04:10:00+00:00 2024-07-04T04:05:01.094963749Z [2024-07-04T04:05:01.094+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T04:05:01.094992456Z 2024-07-04T04:05:01.095016391Z 2024-07-04T04:05:01.095020815Z 2024-07-04T04:05:01.095353434Z [2024-07-04T04:05:01.095+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:05:01.095605327Z [2024-07-04T04:05:01.095+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:05:01.095826205Z [2024-07-04T04:05:01.095+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:05:01.096717876Z [2024-07-04T04:05:01.096+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:05:01.096732798Z 2024-07-04T04:05:01.096737655Z 2024-07-04T04:05:01.096741829Z 2024-07-04T04:05:01.101592703Z [2024-07-04T04:05:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-07-04T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-07-04T04:05:01.101860642Z [2024-07-04T04:05:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:05:01.102193658Z [2024-07-04T04:05:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:05:01.102418354Z [2024-07-04T04:05:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:05:01.102732274Z [2024-07-04T04:05:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:05:01.102943255Z [2024-07-04T04:05:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:05:01.540444760Z [2024-07-04T04:05:01.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status queued for try_number 1 2024-07-04T04:05:01.540502776Z [2024-07-04T04:05:01.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:04:00+00:00 exited with status queued for try_number 1 2024-07-04T04:05:01.541809980Z [2024-07-04T04:05:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:04:00+00:00 exited with status queued for try_number 1 2024-07-04T04:05:01.569354113Z [2024-07-04T04:05:01.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd4249f7-e042-4461-a0ec-16e490225e66 2024-07-04T04:05:01.569427846Z [2024-07-04T04:05:01.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8453d640-3cef-43a5-8314-2528da273280 2024-07-04T04:05:01.569525222Z [2024-07-04T04:05:01.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f3138ef-4224-4404-82bc-82fbd7d5f5ef 2024-07-04T04:05:05.043833459Z [2024-07-04T04:05:05.043+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T04:05:05.043872258Z 2024-07-04T04:05:05.043936341Z [2024-07-04T04:05:05.043+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:05:05.044474065Z [2024-07-04T04:05:05.044+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:05:05.044490662Z 2024-07-04T04:05:05.047166010Z [2024-07-04T04:05:05.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='split_metrics', run_id='scheduled__2024-07-04T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-07-04T04:05:05.047210155Z [2024-07-04T04:05:05.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:05:05.109871220Z [2024-07-04T04:05:05.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status queued for try_number 1 2024-07-04T04:05:05.110009804Z [2024-07-04T04:05:05.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.extract_metrics_from_vnfrs run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status success for try_number 1 2024-07-04T04:05:05.110173300Z [2024-07-04T04:05:05.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:04:00+00:00 exited with status success for try_number 1 2024-07-04T04:05:05.119305061Z [2024-07-04T04:05:05.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cb9fd88-d58f-467e-b904-06fca71b72fa 2024-07-04T04:05:05.119501814Z [2024-07-04T04:05:05.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-07-04T04:00:00+00:00, map_index=-1, run_start_date=2024-07-04 04:05:03.593533+00:00, run_end_date=2024-07-04 04:05:04.101247+00:00, run_duration=0.507714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:05:01.098020+00:00, queued_by_job_id=2, pid=12351 2024-07-04T04:05:05.119719489Z [2024-07-04T04:05:05.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:04:00+00:00, map_index=-1, run_start_date=2024-07-04 04:05:03.243459+00:00, run_end_date=2024-07-04 04:05:04.874047+00:00, run_duration=1.630588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:05:01.098020+00:00, queued_by_job_id=2, pid=12341 2024-07-04T04:05:05.159320803Z [2024-07-04T04:05:05.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:05:05.159543872Z [2024-07-04T04:05:05.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:04:00+00:00, run_id=scheduled__2024-07-04T04:04:00+00:00, run_start_date=2024-07-04 04:05:01.031907+00:00, run_end_date=2024-07-04 04:05:05.159193+00:00, run_duration=4.127286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:04:00+00:00, data_interval_end=2024-07-04 04:05:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T04:05:05.169468294Z [2024-07-04T04:05:05.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:05:00+00:00, run_after=2024-07-04T04:06:00+00:00 2024-07-04T04:05:06.291932650Z [2024-07-04T04:05:06.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:05:06.292773478Z [2024-07-04T04:05:06.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:04:00+00:00, run_id=scheduled__2024-07-04T04:04:00+00:00, run_start_date=2024-07-04 04:05:01.032913+00:00, run_end_date=2024-07-04 04:05:06.292253+00:00, run_duration=5.25934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:04:00+00:00, data_interval_end=2024-07-04 04:05:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T04:05:06.307823012Z [2024-07-04T04:05:06.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:05:00+00:00, run_after=2024-07-04T04:06:00+00:00 2024-07-04T04:05:06.384709409Z [2024-07-04T04:05:06.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:04:00+00:00 exited with status success for try_number 1 2024-07-04T04:05:06.399386601Z [2024-07-04T04:05:06.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:04:00+00:00, map_index=-1, run_start_date=2024-07-04 04:05:03.225701+00:00, run_end_date=2024-07-04 04:05:05.230329+00:00, run_duration=2.004628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:05:01.098020+00:00, queued_by_job_id=2, pid=12340 2024-07-04T04:05:07.488661358Z [2024-07-04T04:05:07.488+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T04:05:07.488693309Z 2024-07-04T04:05:07.489055979Z [2024-07-04T04:05:07.488+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:05:07.490522920Z [2024-07-04T04:05:07.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:05:07.490555763Z 2024-07-04T04:05:07.494636827Z [2024-07-04T04:05:07.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='collect_metrics', run_id='scheduled__2024-07-04T04:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-07-04T04:05:07.495064478Z [2024-07-04T04:05:07.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T04:05:07.571140015Z [2024-07-04T04:05:07.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status queued for try_number 1 2024-07-04T04:05:07.571283551Z [2024-07-04T04:05:07.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.split_metrics run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status success for try_number 1 2024-07-04T04:05:07.581067141Z [2024-07-04T04:05:07.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74abdefa-854a-47e6-a0f2-e63dd52113e2 2024-07-04T04:05:07.581298212Z [2024-07-04T04:05:07.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=split_metrics, run_id=scheduled__2024-07-04T04:00:00+00:00, map_index=-1, run_start_date=2024-07-04 04:05:06.695060+00:00, run_end_date=2024-07-04 04:05:07.091541+00:00, run_duration=0.396481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:05:05.044745+00:00, queued_by_job_id=2, pid=12389 2024-07-04T04:05:10.615667206Z [2024-07-04T04:05:10.615+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-07-04T04:05:10.615717992Z 2024-07-04T04:05:10.615785715Z [2024-07-04T04:05:10.615+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:05:10.616448815Z [2024-07-04T04:05:10.616+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:05:10.616473035Z 2024-07-04T04:05:10.620192703Z [2024-07-04T04:05:10.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='send_prometheus', run_id='scheduled__2024-07-04T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:05:10.623834706Z [2024-07-04T04:05:10.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:05:10.689521608Z [2024-07-04T04:05:10.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status queued for try_number 1 2024-07-04T04:05:10.690205599Z [2024-07-04T04:05:10.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.collect_metrics run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status success for try_number 1 2024-07-04T04:05:10.698820899Z [2024-07-04T04:05:10.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to de90165c-d9bf-42ce-8d26-34b8aa9676f1 2024-07-04T04:05:10.699258445Z [2024-07-04T04:05:10.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=collect_metrics, run_id=scheduled__2024-07-04T04:00:00+00:00, map_index=0, run_start_date=2024-07-04 04:05:09.095687+00:00, run_end_date=2024-07-04 04:05:09.477764+00:00, run_duration=0.382077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:05:07.491283+00:00, queued_by_job_id=2, pid=12401 2024-07-04T04:05:12.956587118Z [2024-07-04T04:05:12.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:05:12.957292637Z [2024-07-04T04:05:12.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:00:00+00:00, run_id=scheduled__2024-07-04T04:00:00+00:00, run_start_date=2024-07-04 04:05:01.030698+00:00, run_end_date=2024-07-04 04:05:12.956577+00:00, run_duration=11.925879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:00:00+00:00, data_interval_end=2024-07-04 04:05:00+00:00, dag_hash=5fd456ee805dfb530b44083fecd1fe44 2024-07-04T04:05:12.975553105Z [2024-07-04T04:05:12.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:05:00+00:00, run_after=2024-07-04T04:10:00+00:00 2024-07-04T04:05:13.015293155Z [2024-07-04T04:05:13.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.send_prometheus run_id=scheduled__2024-07-04T04:00:00+00:00 exited with status success for try_number 1 2024-07-04T04:05:13.023218327Z [2024-07-04T04:05:13.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=send_prometheus, run_id=scheduled__2024-07-04T04:00:00+00:00, map_index=-1, run_start_date=2024-07-04 04:05:12.314577+00:00, run_end_date=2024-07-04 04:05:12.725089+00:00, run_duration=0.410512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:05:10.617031+00:00, queued_by_job_id=2, pid=12413 2024-07-04T04:06:00.923378972Z [2024-07-04T04:06:00.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:06:00+00:00, run_after=2024-07-04T04:07:00+00:00 2024-07-04T04:06:00.931338813Z [2024-07-04T04:06:00.931+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:06:00.940036524Z [2024-07-04T04:06:00.939+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:06:01.024718539Z [2024-07-04T04:06:01.024+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T04:06:01.024811526Z 2024-07-04T04:06:01.024823401Z 2024-07-04T04:06:01.024831045Z 2024-07-04T04:06:01.024898401Z [2024-07-04T04:06:01.024+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T04:06:01.025725104Z [2024-07-04T04:06:01.025+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:06:01.026111601Z [2024-07-04T04:06:01.025+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:06:01.026956665Z [2024-07-04T04:06:01.026+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:06:01.026972642Z 2024-07-04T04:06:01.026977010Z 2024-07-04T04:06:01.026980619Z 2024-07-04T04:06:01.031669116Z [2024-07-04T04:06:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:06:01.031968971Z [2024-07-04T04:06:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:06:01.032298242Z [2024-07-04T04:06:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:06:01.032514613Z [2024-07-04T04:06:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:06:01.032868970Z [2024-07-04T04:06:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:06:01.033125899Z [2024-07-04T04:06:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:06:01.442314767Z [2024-07-04T04:06:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T04:04:00+00:00 exited with status queued for try_number 1 2024-07-04T04:06:01.442563097Z [2024-07-04T04:06:01.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:05:00+00:00 exited with status queued for try_number 1 2024-07-04T04:06:01.442788970Z [2024-07-04T04:06:01.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:05:00+00:00 exited with status queued for try_number 1 2024-07-04T04:06:01.461585970Z [2024-07-04T04:06:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6208173-971d-48b0-a170-0916a08977f5 2024-07-04T04:06:01.461627325Z [2024-07-04T04:06:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dcef296-8bc6-4e3d-baba-47d5e350fa0a 2024-07-04T04:06:01.461805634Z [2024-07-04T04:06:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf58cb40-52bf-4b51-988f-61dc33bc65bc 2024-07-04T04:06:02.681232058Z [2024-07-04T04:06:02.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:06:02.681924692Z [2024-07-04T04:06:02.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 04:04:00+00:00, run_id=scheduled__2024-07-04T04:04:00+00:00, run_start_date=2024-07-04 04:06:00.956414+00:00, run_end_date=2024-07-04 04:06:02.681122+00:00, run_duration=1.724708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:04:00+00:00, data_interval_end=2024-07-04 04:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T04:06:02.700250770Z [2024-07-04T04:06:02.699+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T04:06:00+00:00, run_after=2024-07-04T04:08:00+00:00 2024-07-04T04:06:02.764474774Z [2024-07-04T04:06:02.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T04:04:00+00:00 exited with status success for try_number 1 2024-07-04T04:06:02.773209261Z [2024-07-04T04:06:02.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T04:04:00+00:00, map_index=-1, run_start_date=2024-07-04 04:06:01.985712+00:00, run_end_date=2024-07-04 04:06:02.390444+00:00, run_duration=0.404732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:06:01.027968+00:00, queued_by_job_id=2, pid=12429 2024-07-04T04:06:06.048168252Z [2024-07-04T04:06:06.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:06:06.048674074Z [2024-07-04T04:06:06.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:05:00+00:00, run_id=scheduled__2024-07-04T04:05:00+00:00, run_start_date=2024-07-04 04:06:00.958061+00:00, run_end_date=2024-07-04 04:06:06.048034+00:00, run_duration=5.089973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:05:00+00:00, data_interval_end=2024-07-04 04:06:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T04:06:06.059832115Z [2024-07-04T04:06:06.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:06:00+00:00, run_after=2024-07-04T04:07:00+00:00 2024-07-04T04:06:06.105962088Z [2024-07-04T04:06:06.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:05:00+00:00 exited with status success for try_number 1 2024-07-04T04:06:06.113849527Z [2024-07-04T04:06:06.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:05:00+00:00, map_index=-1, run_start_date=2024-07-04 04:06:03.344293+00:00, run_end_date=2024-07-04 04:06:05.288468+00:00, run_duration=1.944175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:06:01.027968+00:00, queued_by_job_id=2, pid=12460 2024-07-04T04:06:07.163921049Z [2024-07-04T04:06:07.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:06:07.164008844Z [2024-07-04T04:06:07.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:05:00+00:00, run_id=scheduled__2024-07-04T04:05:00+00:00, run_start_date=2024-07-04 04:06:00.959191+00:00, run_end_date=2024-07-04 04:06:07.163730+00:00, run_duration=6.204539, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:05:00+00:00, data_interval_end=2024-07-04 04:06:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T04:06:07.173031324Z [2024-07-04T04:06:07.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:06:00+00:00, run_after=2024-07-04T04:07:00+00:00 2024-07-04T04:06:07.216350591Z [2024-07-04T04:06:07.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:05:00+00:00 exited with status success for try_number 1 2024-07-04T04:06:07.226218090Z [2024-07-04T04:06:07.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:05:00+00:00, map_index=-1, run_start_date=2024-07-04 04:06:03.275577+00:00, run_end_date=2024-07-04 04:06:05.926074+00:00, run_duration=2.650497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:06:01.027968+00:00, queued_by_job_id=2, pid=12459 2024-07-04T04:06:23.191293737Z [2024-07-04T04:06:23.190+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-07-04T04:07:00.429777124Z [2024-07-04T04:07:00.429+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:07:00.444197074Z [2024-07-04T04:07:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:07:00+00:00, run_after=2024-07-04T04:08:00+00:00 2024-07-04T04:07:00.518186654Z [2024-07-04T04:07:00.517+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-07-04T04:07:00.518218248Z 2024-07-04T04:07:00.518222275Z 2024-07-04T04:07:00.518417337Z [2024-07-04T04:07:00.518+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:07:00.518607366Z [2024-07-04T04:07:00.518+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:07:00.519285226Z [2024-07-04T04:07:00.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:07:00.519297875Z 2024-07-04T04:07:00.519301483Z 2024-07-04T04:07:00.525337723Z [2024-07-04T04:07:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:07:00.525604422Z [2024-07-04T04:07:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:07:00.525968953Z [2024-07-04T04:07:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:07:00.526204421Z [2024-07-04T04:07:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:07:00.723316868Z [2024-07-04T04:07:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:06:00+00:00 exited with status queued for try_number 1 2024-07-04T04:07:00.723481839Z [2024-07-04T04:07:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:06:00+00:00 exited with status queued for try_number 1 2024-07-04T04:07:00.731514305Z [2024-07-04T04:07:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63506a65-05c4-4654-888e-528500747c27 2024-07-04T04:07:00.731745906Z [2024-07-04T04:07:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bff2b57-6677-46b7-b60f-f389ca31b478 2024-07-04T04:07:04.189386943Z [2024-07-04T04:07:04.188+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:07:04.189564862Z [2024-07-04T04:07:04.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:06:00+00:00, run_id=scheduled__2024-07-04T04:06:00+00:00, run_start_date=2024-07-04 04:07:00.457235+00:00, run_end_date=2024-07-04 04:07:04.189230+00:00, run_duration=3.731995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:06:00+00:00, data_interval_end=2024-07-04 04:07:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T04:07:04.199282912Z [2024-07-04T04:07:04.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:07:00+00:00, run_after=2024-07-04T04:08:00+00:00 2024-07-04T04:07:04.262246268Z [2024-07-04T04:07:04.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:06:00+00:00 exited with status success for try_number 1 2024-07-04T04:07:04.268251843Z [2024-07-04T04:07:04.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:06:00+00:00, map_index=-1, run_start_date=2024-07-04 04:07:02.342666+00:00, run_end_date=2024-07-04 04:07:03.837588+00:00, run_duration=1.494922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:07:00.519987+00:00, queued_by_job_id=2, pid=12514 2024-07-04T04:07:05.319221225Z [2024-07-04T04:07:05.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:07:05.319269800Z [2024-07-04T04:07:05.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:06:00+00:00, run_id=scheduled__2024-07-04T04:06:00+00:00, run_start_date=2024-07-04 04:07:00.458516+00:00, run_end_date=2024-07-04 04:07:05.318942+00:00, run_duration=4.860426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:06:00+00:00, data_interval_end=2024-07-04 04:07:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T04:07:05.339092912Z [2024-07-04T04:07:05.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:07:00+00:00, run_after=2024-07-04T04:08:00+00:00 2024-07-04T04:07:05.380031125Z [2024-07-04T04:07:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:06:00+00:00 exited with status success for try_number 1 2024-07-04T04:07:05.386924281Z [2024-07-04T04:07:05.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:06:00+00:00, map_index=-1, run_start_date=2024-07-04 04:07:02.355211+00:00, run_end_date=2024-07-04 04:07:04.179304+00:00, run_duration=1.824093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:07:00.519987+00:00, queued_by_job_id=2, pid=12515 2024-07-04T04:08:01.042686438Z [2024-07-04T04:08:01.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:08:00+00:00, run_after=2024-07-04T04:09:00+00:00 2024-07-04T04:08:01.058394316Z [2024-07-04T04:08:01.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:08:01.071363524Z [2024-07-04T04:08:01.071+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-07-04T04:08:01.160439836Z [2024-07-04T04:08:01.159+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-07-04T04:08:01.160470790Z 2024-07-04T04:08:01.160474870Z 2024-07-04T04:08:01.160478333Z 2024-07-04T04:08:01.160528045Z [2024-07-04T04:08:01.160+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-07-04T04:08:01.160681172Z [2024-07-04T04:08:01.160+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:08:01.160778914Z [2024-07-04T04:08:01.160+0000] {scheduler_job.py:425} INFO - DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 has 0/16 running and queued tasks 2024-07-04T04:08:01.161480749Z [2024-07-04T04:08:01.161+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-07-04T04:08:01.161497457Z 2024-07-04T04:08:01.161503051Z 2024-07-04T04:08:01.161516124Z 2024-07-04T04:08:01.165561616Z [2024-07-04T04:08:01.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-07-04T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:08:01.165747534Z [2024-07-04T04:08:01.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:08:01.166045719Z [2024-07-04T04:08:01.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:08:01.166129934Z [2024-07-04T04:08:01.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:08:01.166369568Z [2024-07-04T04:08:01.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-07-04T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-07-04T04:08:01.166472885Z [2024-07-04T04:08:01.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:08:01.596536586Z [2024-07-04T04:08:01.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T04:06:00+00:00 exited with status queued for try_number 1 2024-07-04T04:08:01.596976316Z [2024-07-04T04:08:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:07:00+00:00 exited with status queued for try_number 1 2024-07-04T04:08:01.597204624Z [2024-07-04T04:08:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:07:00+00:00 exited with status queued for try_number 1 2024-07-04T04:08:01.625611535Z [2024-07-04T04:08:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21b4d044-0879-455d-85ae-b8cecc3fd584 2024-07-04T04:08:01.626031628Z [2024-07-04T04:08:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8aefc810-1ad0-466c-bd57-1409406e35c4 2024-07-04T04:08:01.626428909Z [2024-07-04T04:08:01.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d858c4e-17f0-454d-b177-529cc59c92ae 2024-07-04T04:08:03.030966058Z [2024-07-04T04:08:03.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:08:03.031275644Z [2024-07-04T04:08:03.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-07-04 04:06:00+00:00, run_id=scheduled__2024-07-04T04:06:00+00:00, run_start_date=2024-07-04 04:08:01.083747+00:00, run_end_date=2024-07-04 04:08:03.030941+00:00, run_duration=1.947194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:06:00+00:00, data_interval_end=2024-07-04 04:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-07-04T04:08:03.039672888Z [2024-07-04T04:08:03.039+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-07-04T04:08:00+00:00, run_after=2024-07-04T04:10:00+00:00 2024-07-04T04:08:03.139796052Z [2024-07-04T04:08:03.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-07-04T04:06:00+00:00 exited with status success for try_number 1 2024-07-04T04:08:03.152664340Z [2024-07-04T04:08:03.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-07-04T04:06:00+00:00, map_index=-1, run_start_date=2024-07-04 04:08:02.267037+00:00, run_end_date=2024-07-04 04:08:02.686100+00:00, run_duration=0.419063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:08:01.162292+00:00, queued_by_job_id=2, pid=12550 2024-07-04T04:08:05.287105887Z [2024-07-04T04:08:05.286+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:08:05.287384129Z [2024-07-04T04:08:05.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:07:00+00:00, run_id=scheduled__2024-07-04T04:07:00+00:00, run_start_date=2024-07-04 04:08:01.087275+00:00, run_end_date=2024-07-04 04:08:05.287002+00:00, run_duration=4.199727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:07:00+00:00, data_interval_end=2024-07-04 04:08:00+00:00, dag_hash=2aa2b03d49158f9b4c7fa429dcb66cca 2024-07-04T04:08:05.295736987Z [2024-07-04T04:08:05.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:08:00+00:00, run_after=2024-07-04T04:09:00+00:00 2024-07-04T04:08:05.356921711Z [2024-07-04T04:08:05.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:07:00+00:00 exited with status success for try_number 1 2024-07-04T04:08:05.367645214Z [2024-07-04T04:08:05.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:07:00+00:00, map_index=-1, run_start_date=2024-07-04 04:08:03.346944+00:00, run_end_date=2024-07-04 04:08:04.861506+00:00, run_duration=1.514562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:08:01.162292+00:00, queued_by_job_id=2, pid=12580 2024-07-04T04:08:06.417550391Z [2024-07-04T04:08:06.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-07-04T04:08:06.417978357Z [2024-07-04T04:08:06.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, execution_date=2024-07-04 04:07:00+00:00, run_id=scheduled__2024-07-04T04:07:00+00:00, run_start_date=2024-07-04 04:08:01.088483+00:00, run_end_date=2024-07-04 04:08:06.417468+00:00, run_duration=5.328985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-07-04 04:07:00+00:00, data_interval_end=2024-07-04 04:08:00+00:00, dag_hash=69ab1c5b431edee0a30ee8b6a061469b 2024-07-04T04:08:06.426637701Z [2024-07-04T04:08:06.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 to 2024-07-04T04:08:00+00:00, run_after=2024-07-04T04:09:00+00:00 2024-07-04T04:08:06.489185089Z [2024-07-04T04:08:06.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-07-04T04:07:00+00:00 exited with status success for try_number 1 2024-07-04T04:08:06.502009236Z [2024-07-04T04:08:06.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-07-04T04:07:00+00:00, map_index=-1, run_start_date=2024-07-04 04:08:03.320751+00:00, run_end_date=2024-07-04 04:08:05.545395+00:00, run_duration=2.224644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-07-04 04:08:01.162292+00:00, queued_by_job_id=2, pid=12579 2024-07-04T01:26:09.847054813Z 2024-07-04T01:26:09.852963967Z Cleaning logs every 900 seconds 2024-07-04T01:26:09.852984064Z Trimming airflow logs to 15 days. 2024-07-04T01:30:00.952323961Z Trimming airflow logs to 15 days. 2024-07-04T01:30:01.987620591Z Trimming airflow logs to 15 days. 2024-07-04T01:45:00.044288293Z Trimming airflow logs to 15 days. 2024-07-04T01:45:01.068966230Z Trimming airflow logs to 15 days. 2024-07-04T02:00:00.120175839Z Trimming airflow logs to 15 days. 2024-07-04T02:00:01.147174721Z Trimming airflow logs to 15 days. 2024-07-04T02:15:00.183324698Z Trimming airflow logs to 15 days. 2024-07-04T02:15:01.219252112Z Trimming airflow logs to 15 days. 2024-07-04T02:30:00.260713255Z Trimming airflow logs to 15 days. 2024-07-04T02:30:01.303657281Z Trimming airflow logs to 15 days. 2024-07-04T02:45:00.347222552Z Trimming airflow logs to 15 days. 2024-07-04T02:45:01.363797897Z Trimming airflow logs to 15 days. 2024-07-04T03:00:00.403501121Z Trimming airflow logs to 15 days. 2024-07-04T03:00:01.449566099Z Trimming airflow logs to 15 days. 2024-07-04T03:15:00.509125958Z Trimming airflow logs to 15 days. 2024-07-04T03:15:01.538313559Z Trimming airflow logs to 15 days. 2024-07-04T03:30:00.617763640Z Trimming airflow logs to 15 days. 2024-07-04T03:30:01.656947127Z Trimming airflow logs to 15 days. 2024-07-04T03:45:00.704011753Z Trimming airflow logs to 15 days. 2024-07-04T03:45:01.741284046Z Trimming airflow logs to 15 days. 2024-07-04T04:00:00.795547137Z Trimming airflow logs to 15 days. 2024-07-04T04:00:01.828190138Z Trimming airflow logs to 15 days. 2024-07-04T01:25:47.728462111Z 2024-07-04T01:25:48.462903851Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-07-04T01:25:49.948187928Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-07-04T01:25:54.907438213Z [2024-07-04T01:25:54.905+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s)