2024-04-03T01:26:14.784170613Z 2024-04-03T01:26:14.795506131Z Cleaning logs every 900 seconds 2024-04-03T01:26:14.795525520Z Trimming airflow logs to 15 days. 2024-04-03T01:30:01.012029032Z Trimming airflow logs to 15 days. 2024-04-03T01:45:00.075237614Z Trimming airflow logs to 15 days. 2024-04-03T01:45:01.103719353Z Trimming airflow logs to 15 days. 2024-04-03T02:00:00.134295748Z Trimming airflow logs to 15 days. 2024-04-03T02:00:01.219201130Z Trimming airflow logs to 15 days. 2024-04-03T02:15:00.264031092Z Trimming airflow logs to 15 days. 2024-04-03T02:15:01.286831435Z Trimming airflow logs to 15 days. 2024-04-03T02:30:00.331219935Z Trimming airflow logs to 15 days. 2024-04-03T02:30:01.354640915Z Trimming airflow logs to 15 days. 2024-04-03T02:45:00.431352254Z Trimming airflow logs to 15 days. 2024-04-03T02:45:01.478444864Z Trimming airflow logs to 15 days. 2024-04-03T03:00:00.546552616Z Trimming airflow logs to 15 days. 2024-04-03T03:00:01.573792757Z Trimming airflow logs to 15 days. 2024-04-03T03:15:00.605719898Z Trimming airflow logs to 15 days. 2024-04-03T03:15:01.646848343Z Trimming airflow logs to 15 days. 2024-04-03T03:30:00.669573837Z Trimming airflow logs to 15 days. 2024-04-03T03:30:01.698051454Z Trimming airflow logs to 15 days. 2024-04-03T03:45:00.728470668Z Trimming airflow logs to 15 days. 2024-04-03T03:45:01.764017341Z Trimming airflow logs to 15 days. 2024-04-03T04:00:00.828535773Z Trimming airflow logs to 15 days. 2024-04-03T04:00:01.878253710Z Trimming airflow logs to 15 days. 2024-04-03T04:15:00.925138250Z Trimming airflow logs to 15 days. 2024-04-03T04:15:01.980320867Z Trimming airflow logs to 15 days. 2024-04-03T01:25:30.415917638Z .. 2024-04-03T01:25:31.752716188Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-03T01:25:32.738481502Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-03T01:25:43.512748044Z [2024-04-03T01:25:43.498+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-03T01:25:44.520997721Z [2024-04-03T01:25:44.520+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-04-03T01:25:45.524972453Z [2024-04-03T01:25:45.523+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-04-03T01:25:46.530506682Z [2024-04-03T01:25:46.526+0000] {db.py:755} INFO - Waiting for migrations... 3 second(s) 2024-04-03T01:25:47.529335653Z [2024-04-03T01:25:47.528+0000] {db.py:755} INFO - Waiting for migrations... 4 second(s) 2024-04-03T01:25:48.535670128Z [2024-04-03T01:25:48.531+0000] {db.py:755} INFO - Waiting for migrations... 5 second(s) 2024-04-03T01:25:49.549675518Z [2024-04-03T01:25:49.546+0000] {db.py:755} INFO - Waiting for migrations... 6 second(s) 2024-04-03T01:25:50.551100216Z [2024-04-03T01:25:50.549+0000] {db.py:755} INFO - Waiting for migrations... 7 second(s) 2024-04-03T01:25:51.575285040Z [2024-04-03T01:25:51.574+0000] {db.py:755} INFO - Waiting for migrations... 8 second(s) 2024-04-03T01:26:16.132031937Z 2024-04-03T01:26:18.229192024Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-03T01:26:20.630241426Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-03T01:26:34.203744725Z ____________ _____________ 2024-04-03T01:26:34.203762305Z ____ |__( )_________ __/__ /________ __ 2024-04-03T01:26:34.203765559Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-04-03T01:26:34.203768740Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-04-03T01:26:34.203771642Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-04-03T01:26:34.203775010Z [2024-04-03T01:26:34.203+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-04-03T01:26:34.204604806Z [2024-04-03T01:26:34.203+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-04-03T01:26:34.619154690Z [2024-04-03T01:26:34.618+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-04-03T01:26:34.634898055Z [2024-04-03T01:26:34.627+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 28 2024-04-03T01:26:34.637100161Z [2024-04-03T01:26:34.636+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T01:26:34.737178424Z [2024-04-03T01:26:34.707+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-04-03T01:26:34.766700501Z [2024-04-03T01:26:34.746+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-04-03T01:26:54.997146130Z [2024-04-03T01:26:54.996+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:26:55.118048431Z [2024-04-03T01:26:55.117+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:26:55.118060335Z 2024-04-03T01:26:55.119310041Z [2024-04-03T01:26:55.118+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:26:55.134077341Z [2024-04-03T01:26:55.133+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:26:55.134089259Z 2024-04-03T01:26:55.166585112Z [2024-04-03T01:26:55.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:26:55.173226792Z [2024-04-03T01:26:55.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:26:56.175091060Z [2024-04-03T01:26:56.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:24:00+00:00 exited with status queued for try_number 1 2024-04-03T01:26:56.245093099Z [2024-04-03T01:26:56.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22829b79-786d-427d-b4db-893abd1da5b4 2024-04-03T01:27:01.061172314Z [2024-04-03T01:27:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:24:00+00:00 exited with status success for try_number 1 2024-04-03T01:27:01.076750762Z [2024-04-03T01:27:01.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:24:00+00:00, map_index=-1, run_start_date=2024-04-03 01:26:58.912814+00:00, run_end_date=2024-04-03 01:26:59.653023+00:00, run_duration=0.740209, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:26:55.137734+00:00, queued_by_job_id=1, pid=48 2024-04-03T01:27:09.855628603Z [2024-04-03T01:27:09.855+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:27:09.855670155Z 2024-04-03T01:27:09.856046667Z [2024-04-03T01:27:09.855+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:27:09.856710492Z [2024-04-03T01:27:09.856+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:27:09.856721453Z 2024-04-03T01:27:09.862263277Z [2024-04-03T01:27:09.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:24:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:27:09.862420331Z [2024-04-03T01:27:09.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:27:09.921813917Z [2024-04-03T01:27:09.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:24:00+00:00 exited with status queued for try_number 2 2024-04-03T01:27:09.933183823Z [2024-04-03T01:27:09.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19ba3695-f27a-4245-a7a5-683874c40ddd 2024-04-03T01:27:12.850552096Z [2024-04-03T01:27:12.849+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T01:27:12.850907761Z [2024-04-03T01:27:12.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:24:00+00:00, run_id=scheduled__2024-04-03T01:24:00+00:00, run_start_date=2024-04-03 01:26:55.016954+00:00, run_end_date=2024-04-03 01:27:12.850355+00:00, run_duration=17.833401, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:24:00+00:00, data_interval_end=2024-04-03 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:27:12.867158006Z [2024-04-03T01:27:12.866+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:26:00+00:00, run_after=2024-04-03T01:28:00+00:00 2024-04-03T01:27:12.939068495Z [2024-04-03T01:27:12.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:24:00+00:00 exited with status success for try_number 2 2024-04-03T01:27:12.960526276Z [2024-04-03T01:27:12.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:24:00+00:00, map_index=-1, run_start_date=2024-04-03 01:27:11.089977+00:00, run_end_date=2024-04-03 01:27:11.784909+00:00, run_duration=0.694932, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:27:09.857256+00:00, queued_by_job_id=1, pid=59 2024-04-03T01:28:01.053416680Z [2024-04-03T01:28:01.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:28:01.111519574Z [2024-04-03T01:28:01.110+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:28:01.111534216Z 2024-04-03T01:28:01.111755333Z [2024-04-03T01:28:01.111+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:28:01.112442268Z [2024-04-03T01:28:01.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:28:01.112452570Z 2024-04-03T01:28:01.118743036Z [2024-04-03T01:28:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:28:01.118940721Z [2024-04-03T01:28:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:28:01.266457049Z [2024-04-03T01:28:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:26:00+00:00 exited with status queued for try_number 1 2024-04-03T01:28:01.272219326Z [2024-04-03T01:28:01.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6d0e275-f370-47b3-bd29-d4e94603a31e 2024-04-03T01:28:04.083886559Z [2024-04-03T01:28:04.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:28:04.084323361Z [2024-04-03T01:28:04.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:26:00+00:00, run_id=scheduled__2024-04-03T01:26:00+00:00, run_start_date=2024-04-03 01:28:01.064945+00:00, run_end_date=2024-04-03 01:28:04.083840+00:00, run_duration=3.018895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:26:00+00:00, data_interval_end=2024-04-03 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:28:04.101712963Z [2024-04-03T01:28:04.101+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:28:00+00:00, run_after=2024-04-03T01:30:00+00:00 2024-04-03T01:28:04.149452481Z [2024-04-03T01:28:04.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:26:00+00:00 exited with status success for try_number 1 2024-04-03T01:28:04.156831150Z [2024-04-03T01:28:04.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:26:00+00:00, map_index=-1, run_start_date=2024-04-03 01:28:02.452483+00:00, run_end_date=2024-04-03 01:28:03.148515+00:00, run_duration=0.696032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:28:01.112933+00:00, queued_by_job_id=1, pid=83 2024-04-03T01:30:00.839903796Z [2024-04-03T01:30:00.839+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:30:00.897054209Z [2024-04-03T01:30:00.896+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:30:00.897131408Z 2024-04-03T01:30:00.897146616Z [2024-04-03T01:30:00.896+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:30:00.902204599Z [2024-04-03T01:30:00.901+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:30:00.902215679Z 2024-04-03T01:30:00.907812466Z [2024-04-03T01:30:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:30:00.907910443Z [2024-04-03T01:30:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:30:00.980581487Z [2024-04-03T01:30:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:28:00+00:00 exited with status queued for try_number 1 2024-04-03T01:30:00.985764242Z [2024-04-03T01:30:00.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57e24518-b7a6-460c-be6f-965063151a0f 2024-04-03T01:30:03.263965608Z [2024-04-03T01:30:03.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:30:03.264442646Z [2024-04-03T01:30:03.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:28:00+00:00, run_id=scheduled__2024-04-03T01:28:00+00:00, run_start_date=2024-04-03 01:30:00.857615+00:00, run_end_date=2024-04-03 01:30:03.263922+00:00, run_duration=2.406307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:28:00+00:00, data_interval_end=2024-04-03 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:30:03.272305424Z [2024-04-03T01:30:03.271+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:30:00+00:00, run_after=2024-04-03T01:32:00+00:00 2024-04-03T01:30:03.308959811Z [2024-04-03T01:30:03.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:28:00+00:00 exited with status success for try_number 1 2024-04-03T01:30:03.313854128Z [2024-04-03T01:30:03.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:28:00+00:00, map_index=-1, run_start_date=2024-04-03 01:30:01.956985+00:00, run_end_date=2024-04-03 01:30:02.383065+00:00, run_duration=0.42608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:30:00.902530+00:00, queued_by_job_id=1, pid=120 2024-04-03T01:31:34.790818761Z [2024-04-03T01:31:34.790+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T01:32:00.604938531Z [2024-04-03T01:32:00.604+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:32:00.653561247Z [2024-04-03T01:32:00.653+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:32:00.653595116Z 2024-04-03T01:32:00.653637370Z [2024-04-03T01:32:00.653+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:32:00.654305452Z [2024-04-03T01:32:00.654+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:32:00.654320693Z 2024-04-03T01:32:00.656857646Z [2024-04-03T01:32:00.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:32:00.657613138Z [2024-04-03T01:32:00.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:32:00.717943577Z [2024-04-03T01:32:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:32:00.724097353Z [2024-04-03T01:32:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18594e17-4b89-44fe-884b-a74fc0840783 2024-04-03T01:32:02.588007974Z [2024-04-03T01:32:02.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:32:02.588230301Z [2024-04-03T01:32:02.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:30:00+00:00, run_id=scheduled__2024-04-03T01:30:00+00:00, run_start_date=2024-04-03 01:32:00.620408+00:00, run_end_date=2024-04-03 01:32:02.587944+00:00, run_duration=1.967536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:30:00+00:00, data_interval_end=2024-04-03 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:32:02.595975317Z [2024-04-03T01:32:02.595+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:32:00+00:00, run_after=2024-04-03T01:34:00+00:00 2024-04-03T01:32:02.630779092Z [2024-04-03T01:32:02.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status success for try_number 1 2024-04-03T01:32:02.637283233Z [2024-04-03T01:32:02.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=-1, run_start_date=2024-04-03 01:32:01.761491+00:00, run_end_date=2024-04-03 01:32:02.207495+00:00, run_duration=0.446004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:32:00.654706+00:00, queued_by_job_id=1, pid=157 2024-04-03T01:33:43.049447277Z [2024-04-03T01:33:43.049+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:33:43.086239587Z [2024-04-03T01:33:43.084+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:33:43.086265407Z 2024-04-03T01:33:43.086429057Z [2024-04-03T01:33:43.086+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:33:43.087209252Z [2024-04-03T01:33:43.086+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:33:43.087218172Z 2024-04-03T01:33:43.090170746Z [2024-04-03T01:33:43.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:33:43.090379917Z [2024-04-03T01:33:43.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:33:43.233506854Z [2024-04-03T01:33:43.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:32:00+00:00 exited with status queued for try_number 1 2024-04-03T01:33:43.239506647Z [2024-04-03T01:33:43.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf380a74-d94f-4fa3-b394-64e901fb6ba0 2024-04-03T01:33:44.464552518Z [2024-04-03T01:33:44.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:33:00+00:00, run_after=2024-04-03T01:34:00+00:00 2024-04-03T01:33:44.529574322Z [2024-04-03T01:33:44.529+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:33:44.529591828Z 2024-04-03T01:33:44.529600234Z [2024-04-03T01:33:44.529+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:33:44.530814386Z [2024-04-03T01:33:44.530+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:33:44.530827015Z 2024-04-03T01:33:44.533566983Z [2024-04-03T01:33:44.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:33:44.533800479Z [2024-04-03T01:33:44.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:33:44.586138674Z [2024-04-03T01:33:44.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:32:00+00:00 exited with status queued for try_number 1 2024-04-03T01:33:44.593277107Z [2024-04-03T01:33:44.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to db02786b-5066-4570-9682-5dfe8c04de89 2024-04-03T01:33:47.925996836Z [2024-04-03T01:33:47.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:33:47.926916188Z [2024-04-03T01:33:47.926+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:32:00+00:00, run_id=scheduled__2024-04-03T01:32:00+00:00, run_start_date=2024-04-03 01:33:43.058943+00:00, run_end_date=2024-04-03 01:33:47.925932+00:00, run_duration=4.866989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:32:00+00:00, data_interval_end=2024-04-03 01:33:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:33:47.937386870Z [2024-04-03T01:33:47.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:33:00+00:00, run_after=2024-04-03T01:34:00+00:00 2024-04-03T01:33:47.974571484Z [2024-04-03T01:33:47.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:32:00+00:00 exited with status success for try_number 1 2024-04-03T01:33:47.978893834Z [2024-04-03T01:33:47.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:32:00+00:00, map_index=-1, run_start_date=2024-04-03 01:33:45.733803+00:00, run_end_date=2024-04-03 01:33:47.375239+00:00, run_duration=1.641436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:33:43.088281+00:00, queued_by_job_id=1, pid=205 2024-04-03T01:33:48.366161115Z [2024-04-03T01:33:48.365+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:33:48.366461359Z [2024-04-03T01:33:48.366+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:32:00+00:00, run_id=scheduled__2024-04-03T01:32:00+00:00, run_start_date=2024-04-03 01:33:44.492745+00:00, run_end_date=2024-04-03 01:33:48.366153+00:00, run_duration=3.873408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:32:00+00:00, data_interval_end=2024-04-03 01:33:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:33:48.376117151Z [2024-04-03T01:33:48.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:33:00+00:00, run_after=2024-04-03T01:34:00+00:00 2024-04-03T01:33:48.428616298Z [2024-04-03T01:33:48.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:32:00+00:00 exited with status success for try_number 1 2024-04-03T01:33:48.437962402Z [2024-04-03T01:33:48.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:32:00+00:00, map_index=-1, run_start_date=2024-04-03 01:33:46.797197+00:00, run_end_date=2024-04-03 01:33:48.147991+00:00, run_duration=1.350794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:33:44.531138+00:00, queued_by_job_id=1, pid=225 2024-04-03T01:33:51.273243990Z [2024-04-03T01:33:51.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:30:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:33:51.290466458Z [2024-04-03T01:33:51.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:30:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:33:51.351359808Z [2024-04-03T01:33:51.351+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:33:51.351369752Z 2024-04-03T01:33:51.351372793Z 2024-04-03T01:33:51.353217888Z [2024-04-03T01:33:51.352+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:33:51.353430833Z [2024-04-03T01:33:51.353+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:33:51.354008492Z [2024-04-03T01:33:51.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:33:51.354016678Z 2024-04-03T01:33:51.354019909Z 2024-04-03T01:33:51.358975439Z [2024-04-03T01:33:51.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:33:51.359168887Z [2024-04-03T01:33:51.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:33:51.360962686Z [2024-04-03T01:33:51.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:33:51.361155019Z [2024-04-03T01:33:51.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:33:51.641996766Z [2024-04-03T01:33:51.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status queued for try_number 1 2024-04-03T01:33:51.642191736Z [2024-04-03T01:33:51.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status queued for try_number 1 2024-04-03T01:33:51.658890683Z [2024-04-03T01:33:51.658+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61e083ba-452c-4d27-9050-671ead7a5072 2024-04-03T01:33:51.659237378Z [2024-04-03T01:33:51.658+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60040a47-4e92-468a-97e4-08a83d02c3c0 2024-04-03T01:33:54.715610458Z [2024-04-03T01:33:54.715+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:33:54.715636032Z 2024-04-03T01:33:54.715639443Z 2024-04-03T01:33:54.715801218Z [2024-04-03T01:33:54.715+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:33:54.715972062Z [2024-04-03T01:33:54.715+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:33:54.716556580Z [2024-04-03T01:33:54.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:33:54.716567313Z 2024-04-03T01:33:54.716570489Z 2024-04-03T01:33:54.721706824Z [2024-04-03T01:33:54.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T01:33:54.722287089Z [2024-04-03T01:33:54.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:33:54.722623040Z [2024-04-03T01:33:54.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='split_metrics', run_id='scheduled__2024-04-03T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T01:33:54.722815250Z [2024-04-03T01:33:54.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'split_metrics', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:33:54.892380267Z [2024-04-03T01:33:54.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status queued for try_number 1 2024-04-03T01:33:54.892462113Z [2024-04-03T01:33:54.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.split_metrics run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status queued for try_number 1 2024-04-03T01:33:54.892591725Z [2024-04-03T01:33:54.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status success for try_number 1 2024-04-03T01:33:54.892725930Z [2024-04-03T01:33:54.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status success for try_number 1 2024-04-03T01:33:54.916804873Z [2024-04-03T01:33:54.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:25:00+00:00, map_index=-1, run_start_date=2024-04-03 01:33:53.711674+00:00, run_end_date=2024-04-03 01:33:54.167883+00:00, run_duration=0.456209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:33:51.354530+00:00, queued_by_job_id=1, pid=258 2024-04-03T01:33:54.917026904Z [2024-04-03T01:33:54.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78024678-c1ad-4145-9c8f-f581fe70f5cd 2024-04-03T01:33:54.917199821Z [2024-04-03T01:33:54.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:25:00+00:00, map_index=-1, run_start_date=2024-04-03 01:33:53.700858+00:00, run_end_date=2024-04-03 01:33:54.080293+00:00, run_duration=0.379435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:33:51.354530+00:00, queued_by_job_id=1, pid=257 2024-04-03T01:33:54.917325116Z [2024-04-03T01:33:54.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72e5e62b-6397-4c35-9dca-d6b21548a836 2024-04-03T01:33:58.318294085Z [2024-04-03T01:33:58.317+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:33:58.318311020Z 2024-04-03T01:33:58.318314742Z 2024-04-03T01:33:58.319881333Z [2024-04-03T01:33:58.318+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:33:58.320278356Z [2024-04-03T01:33:58.320+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:33:58.321830502Z [2024-04-03T01:33:58.321+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:33:58.321842308Z 2024-04-03T01:33:58.321845769Z 2024-04-03T01:33:58.326858089Z [2024-04-03T01:33:58.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:33:58.327158424Z [2024-04-03T01:33:58.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'collect_metrics', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:33:58.327441001Z [2024-04-03T01:33:58.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:33:58.327626257Z [2024-04-03T01:33:58.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:33:58.541619208Z [2024-04-03T01:33:58.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.collect_metrics run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status queued for try_number 1 2024-04-03T01:33:58.542486729Z [2024-04-03T01:33:58.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status queued for try_number 1 2024-04-03T01:33:58.542690290Z [2024-04-03T01:33:58.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status success for try_number 1 2024-04-03T01:33:58.542810542Z [2024-04-03T01:33:58.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.split_metrics run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status success for try_number 1 2024-04-03T01:33:58.561007635Z [2024-04-03T01:33:58.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 339c0dd2-b9f6-4853-8ebd-58674da1fb9c 2024-04-03T01:33:58.561357324Z [2024-04-03T01:33:58.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T01:25:00+00:00, map_index=-1, run_start_date=2024-04-03 01:33:56.777276+00:00, run_end_date=2024-04-03 01:33:57.117018+00:00, run_duration=0.339742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:33:54.717158+00:00, queued_by_job_id=1, pid=300 2024-04-03T01:33:58.561634306Z [2024-04-03T01:33:58.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff213e43-488c-432b-9b36-3ecf5c5e2779 2024-04-03T01:33:58.561862968Z [2024-04-03T01:33:58.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=split_metrics, run_id=scheduled__2024-04-03T01:25:00+00:00, map_index=-1, run_start_date=2024-04-03 01:33:56.745457+00:00, run_end_date=2024-04-03 01:33:57.105135+00:00, run_duration=0.359678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:33:54.717158+00:00, queued_by_job_id=1, pid=299 2024-04-03T01:34:00.287414216Z [2024-04-03T01:34:00.287+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:34:00.311366827Z [2024-04-03T01:34:00.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:34:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:34:00.329194511Z [2024-04-03T01:34:00.328+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:34:00.570706900Z [2024-04-03T01:34:00.570+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:34:00.570737345Z 2024-04-03T01:34:00.570743465Z 2024-04-03T01:34:00.570747932Z 2024-04-03T01:34:00.571910242Z [2024-04-03T01:34:00.571+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:34:00.573345155Z [2024-04-03T01:34:00.573+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:34:00.573583323Z [2024-04-03T01:34:00.573+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:34:00.574232413Z [2024-04-03T01:34:00.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:34:00.574242835Z 2024-04-03T01:34:00.574246297Z 2024-04-03T01:34:00.574249353Z 2024-04-03T01:34:00.584063637Z [2024-04-03T01:34:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:34:00.584391485Z [2024-04-03T01:34:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:34:00.584703198Z [2024-04-03T01:34:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:34:00.584888283Z [2024-04-03T01:34:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:34:00.585213068Z [2024-04-03T01:34:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:34:00.585498998Z [2024-04-03T01:34:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:34:01.450999677Z [2024-04-03T01:34:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:32:00+00:00 exited with status queued for try_number 1 2024-04-03T01:34:01.451241309Z [2024-04-03T01:34:01.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:33:00+00:00 exited with status queued for try_number 1 2024-04-03T01:34:01.451350769Z [2024-04-03T01:34:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:33:00+00:00 exited with status queued for try_number 1 2024-04-03T01:34:01.536287891Z [2024-04-03T01:34:01.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7feb237d-b6db-4c77-8ba4-56aa77059c69 2024-04-03T01:34:01.538753218Z [2024-04-03T01:34:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f2998b8-b94b-4063-9435-234f18619596 2024-04-03T01:34:01.539088310Z [2024-04-03T01:34:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6daaa08b-2da2-4c81-82bd-3676aed44204 2024-04-03T01:34:05.116883289Z [2024-04-03T01:34:05.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:34:05.117415498Z [2024-04-03T01:34:05.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:32:00+00:00, run_id=scheduled__2024-04-03T01:32:00+00:00, run_start_date=2024-04-03 01:34:00.352159+00:00, run_end_date=2024-04-03 01:34:05.116756+00:00, run_duration=4.764597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:32:00+00:00, data_interval_end=2024-04-03 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:34:05.127434028Z [2024-04-03T01:34:05.127+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:34:00+00:00, run_after=2024-04-03T01:36:00+00:00 2024-04-03T01:34:05.242359217Z [2024-04-03T01:34:05.238+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:34:05.242383065Z 2024-04-03T01:34:05.242433980Z 2024-04-03T01:34:05.242460810Z [2024-04-03T01:34:05.242+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:34:05.242566611Z [2024-04-03T01:34:05.242+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:34:05.243557427Z [2024-04-03T01:34:05.243+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:34:05.243583649Z 2024-04-03T01:34:05.243587057Z 2024-04-03T01:34:05.249124316Z [2024-04-03T01:34:05.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:34:05.249238996Z [2024-04-03T01:34:05.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:34:05.249459119Z [2024-04-03T01:34:05.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='send_prometheus', run_id='scheduled__2024-04-03T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:34:05.249575135Z [2024-04-03T01:34:05.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'send_prometheus', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:34:05.600814516Z [2024-04-03T01:34:05.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status queued for try_number 1 2024-04-03T01:34:05.601142998Z [2024-04-03T01:34:05.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.send_prometheus run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status queued for try_number 1 2024-04-03T01:34:05.601342408Z [2024-04-03T01:34:05.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.collect_metrics run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status success for try_number 1 2024-04-03T01:34:05.601592969Z [2024-04-03T01:34:05.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status success for try_number 1 2024-04-03T01:34:05.601797700Z [2024-04-03T01:34:05.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:32:00+00:00 exited with status success for try_number 1 2024-04-03T01:34:05.624686616Z [2024-04-03T01:34:05.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:32:00+00:00, map_index=-1, run_start_date=2024-04-03 01:34:02.909671+00:00, run_end_date=2024-04-03 01:34:04.667311+00:00, run_duration=1.75764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:34:00.579977+00:00, queued_by_job_id=1, pid=326 2024-04-03T01:34:05.625631145Z [2024-04-03T01:34:05.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:25:00+00:00, map_index=0, run_start_date=2024-04-03 01:34:02.469272+00:00, run_end_date=2024-04-03 01:34:04.025130+00:00, run_duration=1.555858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:33:58.323716+00:00, queued_by_job_id=1, pid=327 2024-04-03T01:34:05.626053467Z [2024-04-03T01:34:05.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:25:00+00:00, map_index=0, run_start_date=2024-04-03 01:34:03.892369+00:00, run_end_date=2024-04-03 01:34:05.113424+00:00, run_duration=1.221055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:33:58.323716+00:00, queued_by_job_id=1, pid=328 2024-04-03T01:34:05.626571225Z [2024-04-03T01:34:05.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84a473e2-a656-46ef-81aa-426f310580e6 2024-04-03T01:34:05.626946638Z [2024-04-03T01:34:05.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to bffcb82b-0993-4ea6-9d85-4dd64d393bff 2024-04-03T01:34:08.493543008Z [2024-04-03T01:34:08.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:34:08.493776899Z [2024-04-03T01:34:08.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:33:00+00:00, run_id=scheduled__2024-04-03T01:33:00+00:00, run_start_date=2024-04-03 01:34:00.355821+00:00, run_end_date=2024-04-03 01:34:08.493457+00:00, run_duration=8.137636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:33:00+00:00, data_interval_end=2024-04-03 01:34:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:34:08.509040311Z [2024-04-03T01:34:08.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:34:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:34:08.518555402Z [2024-04-03T01:34:08.518+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:34:08.519958986Z [2024-04-03T01:34:08.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:33:00+00:00, run_id=scheduled__2024-04-03T01:33:00+00:00, run_start_date=2024-04-03 01:34:00.358951+00:00, run_end_date=2024-04-03 01:34:08.518338+00:00, run_duration=8.159387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:33:00+00:00, data_interval_end=2024-04-03 01:34:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:34:08.531514144Z [2024-04-03T01:34:08.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:34:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:34:08.632464140Z [2024-04-03T01:34:08.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:33:00+00:00 exited with status success for try_number 1 2024-04-03T01:34:08.641592775Z [2024-04-03T01:34:08.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:33:00+00:00, map_index=-1, run_start_date=2024-04-03 01:34:06.508499+00:00, run_end_date=2024-04-03 01:34:08.337308+00:00, run_duration=1.828809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:34:00.579977+00:00, queued_by_job_id=1, pid=361 2024-04-03T01:34:09.091913955Z [2024-04-03T01:34:09.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:34:09.092210009Z [2024-04-03T01:34:09.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, execution_date=2024-04-03 01:25:00+00:00, run_id=scheduled__2024-04-03T01:25:00+00:00, run_start_date=2024-04-03 01:33:51.303365+00:00, run_end_date=2024-04-03 01:34:09.091942+00:00, run_duration=17.788577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:25:00+00:00, data_interval_end=2024-04-03 01:30:00+00:00, dag_hash=d80bc6a972b45b64b20e12f167f6b144 2024-04-03T01:34:09.100436007Z [2024-04-03T01:34:09.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:30:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:34:09.188836252Z [2024-04-03T01:34:09.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:33:00+00:00 exited with status success for try_number 1 2024-04-03T01:34:09.210310626Z [2024-04-03T01:34:09.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:33:00+00:00, map_index=-1, run_start_date=2024-04-03 01:34:06.470998+00:00, run_end_date=2024-04-03 01:34:08.405994+00:00, run_duration=1.934996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:34:00.579977+00:00, queued_by_job_id=1, pid=360 2024-04-03T01:34:10.313250054Z [2024-04-03T01:34:10.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:34:10.313471816Z [2024-04-03T01:34:10.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:25:00+00:00, run_id=scheduled__2024-04-03T01:25:00+00:00, run_start_date=2024-04-03 01:33:51.303854+00:00, run_end_date=2024-04-03 01:34:10.313162+00:00, run_duration=19.009308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:25:00+00:00, data_interval_end=2024-04-03 01:30:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T01:34:10.320566057Z [2024-04-03T01:34:10.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:30:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:34:10.347322404Z [2024-04-03T01:34:10.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status success for try_number 1 2024-04-03T01:34:10.347380589Z [2024-04-03T01:34:10.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.send_prometheus run_id=scheduled__2024-04-03T01:25:00+00:00 exited with status success for try_number 1 2024-04-03T01:34:10.355382350Z [2024-04-03T01:34:10.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=send_prometheus, run_id=scheduled__2024-04-03T01:25:00+00:00, map_index=-1, run_start_date=2024-04-03 01:34:08.427805+00:00, run_end_date=2024-04-03 01:34:09.002478+00:00, run_duration=0.574673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:34:05.244103+00:00, queued_by_job_id=1, pid=399 2024-04-03T01:34:10.355518094Z [2024-04-03T01:34:10.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T01:25:00+00:00, map_index=-1, run_start_date=2024-04-03 01:34:08.665326+00:00, run_end_date=2024-04-03 01:34:09.120861+00:00, run_duration=0.455535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:34:05.244103+00:00, queued_by_job_id=1, pid=400 2024-04-03T01:34:16.417143476Z [2024-04-03T01:34:16.416+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:34:16.459115583Z [2024-04-03T01:34:16.458+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:34:16.459131449Z 2024-04-03T01:34:16.459180696Z [2024-04-03T01:34:16.459+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:34:16.459679728Z [2024-04-03T01:34:16.459+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:34:16.459691025Z 2024-04-03T01:34:16.462127229Z [2024-04-03T01:34:16.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:34:16.462247702Z [2024-04-03T01:34:16.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:34:16.544256759Z [2024-04-03T01:34:16.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:33:00+00:00 exited with status queued for try_number 1 2024-04-03T01:34:16.550641112Z [2024-04-03T01:34:16.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5424714-0772-43a6-b057-bb344a6237ff 2024-04-03T01:34:17.766870501Z [2024-04-03T01:34:17.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:34:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:34:17.862402208Z [2024-04-03T01:34:17.862+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:34:17.862433619Z 2024-04-03T01:34:17.862663723Z [2024-04-03T01:34:17.862+0000] {scheduler_job.py:425} INFO - DAG vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:34:17.863452074Z [2024-04-03T01:34:17.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:34:17.863457932Z 2024-04-03T01:34:17.867521404Z [2024-04-03T01:34:17.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:34:17.867741701Z [2024-04-03T01:34:17.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:34:17.949645364Z [2024-04-03T01:34:17.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:33:00+00:00 exited with status queued for try_number 1 2024-04-03T01:34:17.960383329Z [2024-04-03T01:34:17.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86ff32ba-de91-4e30-96ad-2b4543834d86 2024-04-03T01:34:20.577083969Z [2024-04-03T01:34:20.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:34:20.581763285Z [2024-04-03T01:34:20.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, execution_date=2024-04-03 01:33:00+00:00, run_id=scheduled__2024-04-03T01:33:00+00:00, run_start_date=2024-04-03 01:34:16.430771+00:00, run_end_date=2024-04-03 01:34:20.576971+00:00, run_duration=4.1462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:33:00+00:00, data_interval_end=2024-04-03 01:34:00+00:00, dag_hash=2f5854b3dced90a2bce11e43ef89d5b7 2024-04-03T01:34:20.600264666Z [2024-04-03T01:34:20.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:34:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:34:20.660243848Z [2024-04-03T01:34:20.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:33:00+00:00 exited with status success for try_number 1 2024-04-03T01:34:20.666506839Z [2024-04-03T01:34:20.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:33:00+00:00, map_index=-1, run_start_date=2024-04-03 01:34:18.620182+00:00, run_end_date=2024-04-03 01:34:20.375878+00:00, run_duration=1.755696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:34:16.459897+00:00, queued_by_job_id=1, pid=422 2024-04-03T01:34:23.595198898Z [2024-04-03T01:34:23.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:34:23.595377536Z [2024-04-03T01:34:23.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, execution_date=2024-04-03 01:33:00+00:00, run_id=scheduled__2024-04-03T01:33:00+00:00, run_start_date=2024-04-03 01:34:17.798013+00:00, run_end_date=2024-04-03 01:34:23.595124+00:00, run_duration=5.797111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:33:00+00:00, data_interval_end=2024-04-03 01:34:00+00:00, dag_hash=b8a0235e9ea3f7ed10db0c0838a53184 2024-04-03T01:34:23.649799505Z [2024-04-03T01:34:23.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:34:00+00:00, run_after=2024-04-03T01:35:00+00:00 2024-04-03T01:34:23.694014223Z [2024-04-03T01:34:23.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:33:00+00:00 exited with status success for try_number 1 2024-04-03T01:34:23.702568463Z [2024-04-03T01:34:23.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:33:00+00:00, map_index=-1, run_start_date=2024-04-03 01:34:20.978833+00:00, run_end_date=2024-04-03 01:34:22.693420+00:00, run_duration=1.714587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:34:17.863731+00:00, queued_by_job_id=1, pid=445 2024-04-03T01:35:01.040323591Z [2024-04-03T01:35:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:36:00+00:00 2024-04-03T01:35:01.069509815Z [2024-04-03T01:35:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:36:00+00:00 2024-04-03T01:35:01.078139582Z [2024-04-03T01:35:01.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:35:01.098702340Z [2024-04-03T01:35:01.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:35:01.106492439Z [2024-04-03T01:35:01.106+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:35:01.120338762Z [2024-04-03T01:35:01.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:35:01.226146685Z [2024-04-03T01:35:01.225+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-03T01:35:01.226179731Z 2024-04-03T01:35:01.226183437Z 2024-04-03T01:35:01.226201816Z 2024-04-03T01:35:01.226204962Z 2024-04-03T01:35:01.226207899Z 2024-04-03T01:35:01.226210875Z 2024-04-03T01:35:01.226220339Z [2024-04-03T01:35:01.226+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:35:01.226367911Z [2024-04-03T01:35:01.226+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:35:01.226446414Z [2024-04-03T01:35:01.226+0000] {scheduler_job.py:425} INFO - DAG vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:35:01.226525220Z [2024-04-03T01:35:01.226+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:35:01.226622628Z [2024-04-03T01:35:01.226+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:35:01.226685118Z [2024-04-03T01:35:01.226+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:35:01.227477783Z [2024-04-03T01:35:01.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:35:01.227489259Z 2024-04-03T01:35:01.227492419Z 2024-04-03T01:35:01.227495694Z 2024-04-03T01:35:01.227498698Z 2024-04-03T01:35:01.227501673Z 2024-04-03T01:35:01.227504751Z 2024-04-03T01:35:01.233236528Z [2024-04-03T01:35:01.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:35:01.233314475Z [2024-04-03T01:35:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:01.233500430Z [2024-04-03T01:35:01.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:35:01.233560368Z [2024-04-03T01:35:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:01.233740855Z [2024-04-03T01:35:01.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:35:01.233820366Z [2024-04-03T01:35:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:35:01.233953602Z [2024-04-03T01:35:01.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:35:01.234034839Z [2024-04-03T01:35:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:35:01.234370696Z [2024-04-03T01:35:01.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:35:01.234447870Z [2024-04-03T01:35:01.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:35:01.234601361Z [2024-04-03T01:35:01.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:35:01.234700569Z [2024-04-03T01:35:01.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:35:01.791039622Z [2024-04-03T01:35:01.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:35:01.791077067Z [2024-04-03T01:35:01.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:35:01.791081349Z [2024-04-03T01:35:01.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status queued for try_number 1 2024-04-03T01:35:01.791148867Z [2024-04-03T01:35:01.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status queued for try_number 1 2024-04-03T01:35:01.791214052Z [2024-04-03T01:35:01.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status queued for try_number 1 2024-04-03T01:35:01.791266500Z [2024-04-03T01:35:01.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status queued for try_number 1 2024-04-03T01:35:01.816559770Z [2024-04-03T01:35:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to b591eea5-7672-480a-bdfa-5786e4fac921 2024-04-03T01:35:01.816650603Z [2024-04-03T01:35:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a050e2f-bec2-4ea7-91e5-c429e49754d5 2024-04-03T01:35:01.816745627Z [2024-04-03T01:35:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd65fd13-bf90-42a4-9d52-dd00ae5f851a 2024-04-03T01:35:01.816835726Z [2024-04-03T01:35:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2be5c43a-a271-4d6c-9732-6d00f0e2755b 2024-04-03T01:35:01.816925826Z [2024-04-03T01:35:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 123ab188-8ad0-40ab-b5f5-65c9e756e433 2024-04-03T01:35:01.817011560Z [2024-04-03T01:35:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57029698-37a1-4719-9e93-0890129ac3c9 2024-04-03T01:35:05.381062601Z [2024-04-03T01:35:05.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status failed for try_number 1 2024-04-03T01:35:05.390203408Z [2024-04-03T01:35:05.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:01.228808+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:35:05.403643628Z [2024-04-03T01:35:05.399+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:05.416210435Z [2024-04-03T01:35:05.415+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:05.499770701Z [2024-04-03T01:35:05.499+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=extract_metrics_from_vnfrs, execution_date=20240403T013000, start_date=, end_date=20240403T013505 2024-04-03T01:35:06.736020519Z [2024-04-03T01:35:06.735+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:35:06.736068914Z 2024-04-03T01:35:06.736096959Z [2024-04-03T01:35:06.735+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:35:06.737267993Z [2024-04-03T01:35:06.736+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:35:06.737297736Z 2024-04-03T01:35:06.742843714Z [2024-04-03T01:35:06.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T01:35:06.742887816Z [2024-04-03T01:35:06.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:06.799486058Z [2024-04-03T01:35:06.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:35:06.799647470Z [2024-04-03T01:35:06.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status success for try_number 1 2024-04-03T01:35:06.799956026Z [2024-04-03T01:35:06.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status failed for try_number 1 2024-04-03T01:35:06.800154486Z [2024-04-03T01:35:06.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status failed for try_number 1 2024-04-03T01:35:06.815636562Z [2024-04-03T01:35:06.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:01.228808+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:35:06.816435383Z [2024-04-03T01:35:06.816+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:06.819401051Z [2024-04-03T01:35:06.819+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:06.840639491Z [2024-04-03T01:35:06.840+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240403T013400, start_date=, end_date=20240403T013506 2024-04-03T01:35:06.856790598Z [2024-04-03T01:35:06.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:01.228808+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:35:06.857516061Z [2024-04-03T01:35:06.857+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:06.860122890Z [2024-04-03T01:35:06.859+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:06.876555178Z [2024-04-03T01:35:06.876+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240403T013400, start_date=, end_date=20240403T013506 2024-04-03T01:35:06.887533972Z [2024-04-03T01:35:06.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=-1, run_start_date=2024-04-03 01:35:04.888077+00:00, run_end_date=2024-04-03 01:35:05.524181+00:00, run_duration=0.636104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:01.228808+00:00, queued_by_job_id=1, pid=511 2024-04-03T01:35:06.888112574Z [2024-04-03T01:35:06.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd69b266-6b4a-4f56-99f0-5598e0889ece 2024-04-03T01:35:07.684913128Z [2024-04-03T01:35:07.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:35:07.685494487Z [2024-04-03T01:35:07.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:34:00+00:00, run_id=scheduled__2024-04-03T01:34:00+00:00, run_start_date=2024-04-03 01:35:01.138109+00:00, run_end_date=2024-04-03 01:35:07.684897+00:00, run_duration=6.546788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:34:00+00:00, data_interval_end=2024-04-03 01:35:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:35:07.697160364Z [2024-04-03T01:35:07.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:36:00+00:00 2024-04-03T01:35:07.860752750Z [2024-04-03T01:35:07.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status success for try_number 1 2024-04-03T01:35:07.870977347Z [2024-04-03T01:35:07.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:34:00+00:00, map_index=-1, run_start_date=2024-04-03 01:35:05.292445+00:00, run_end_date=2024-04-03 01:35:07.423997+00:00, run_duration=2.131552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:01.228808+00:00, queued_by_job_id=1, pid=522 2024-04-03T01:35:08.937315068Z [2024-04-03T01:35:08.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:35:08.938547509Z [2024-04-03T01:35:08.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:34:00+00:00, run_id=scheduled__2024-04-03T01:34:00+00:00, run_start_date=2024-04-03 01:35:01.139128+00:00, run_end_date=2024-04-03 01:35:08.938043+00:00, run_duration=7.798915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:34:00+00:00, data_interval_end=2024-04-03 01:35:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:35:08.948668415Z [2024-04-03T01:35:08.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:36:00+00:00 2024-04-03T01:35:09.031461834Z [2024-04-03T01:35:09.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status success for try_number 1 2024-04-03T01:35:09.037218810Z [2024-04-03T01:35:09.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:34:00+00:00, map_index=-1, run_start_date=2024-04-03 01:35:05.343231+00:00, run_end_date=2024-04-03 01:35:07.825241+00:00, run_duration=2.48201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:01.228808+00:00, queued_by_job_id=1, pid=525 2024-04-03T01:35:09.627957043Z [2024-04-03T01:35:09.627+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:35:09.627995349Z 2024-04-03T01:35:09.628000260Z [2024-04-03T01:35:09.627+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:35:09.628768394Z [2024-04-03T01:35:09.628+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:35:09.628786314Z 2024-04-03T01:35:09.632767135Z [2024-04-03T01:35:09.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:35:09.632797142Z [2024-04-03T01:35:09.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:35:09.691528411Z [2024-04-03T01:35:09.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:35:09.691949995Z [2024-04-03T01:35:09.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status success for try_number 1 2024-04-03T01:35:09.700073801Z [2024-04-03T01:35:09.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9723f860-9748-406e-9d76-14cfeed9284b 2024-04-03T01:35:09.700657805Z [2024-04-03T01:35:09.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=-1, run_start_date=2024-04-03 01:35:08.612275+00:00, run_end_date=2024-04-03 01:35:08.965423+00:00, run_duration=0.353148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:06.737801+00:00, queued_by_job_id=1, pid=588 2024-04-03T01:35:13.054171119Z [2024-04-03T01:35:13.053+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:35:13.054210275Z 2024-04-03T01:35:13.054324176Z [2024-04-03T01:35:13.054+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:35:13.055944860Z [2024-04-03T01:35:13.055+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:35:13.055981300Z 2024-04-03T01:35:13.058299595Z [2024-04-03T01:35:13.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:35:13.058572320Z [2024-04-03T01:35:13.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:13.111680585Z [2024-04-03T01:35:13.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:35:13.111948509Z [2024-04-03T01:35:13.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status success for try_number 1 2024-04-03T01:35:13.123815685Z [2024-04-03T01:35:13.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=0, run_start_date=2024-04-03 01:35:11.718586+00:00, run_end_date=2024-04-03 01:35:12.091997+00:00, run_duration=0.373411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:09.629283+00:00, queued_by_job_id=1, pid=600 2024-04-03T01:35:13.125019944Z [2024-04-03T01:35:13.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24666cef-66bb-47b1-9c7b-58e2fc88cda0 2024-04-03T01:35:15.577691799Z [2024-04-03T01:35:15.577+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:35:15.577718930Z 2024-04-03T01:35:15.577723786Z [2024-04-03T01:35:15.577+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:35:15.578184315Z [2024-04-03T01:35:15.577+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:35:15.578237827Z 2024-04-03T01:35:15.580113122Z [2024-04-03T01:35:15.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:35:15.580150775Z [2024-04-03T01:35:15.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:15.620726372Z [2024-04-03T01:35:15.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 2 2024-04-03T01:35:15.626759610Z [2024-04-03T01:35:15.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to c76feeea-2abf-4cd3-ab80-006164b851c6 2024-04-03T01:35:15.666307049Z [2024-04-03T01:35:15.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:35:15.666511818Z [2024-04-03T01:35:15.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:30:00+00:00, run_id=scheduled__2024-04-03T01:30:00+00:00, run_start_date=2024-04-03 01:35:01.135241+00:00, run_end_date=2024-04-03 01:35:15.666131+00:00, run_duration=14.53089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:30:00+00:00, data_interval_end=2024-04-03 01:35:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T01:35:15.672107725Z [2024-04-03T01:35:15.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:35:16.860663487Z [2024-04-03T01:35:16.860+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:35:16.860695752Z 2024-04-03T01:35:16.860907128Z [2024-04-03T01:35:16.860+0000] {scheduler_job.py:425} INFO - DAG vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:35:16.861612931Z [2024-04-03T01:35:16.861+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:35:16.861621409Z 2024-04-03T01:35:16.865697756Z [2024-04-03T01:35:16.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:34:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:35:16.867273289Z [2024-04-03T01:35:16.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:35:16.913350446Z [2024-04-03T01:35:16.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status queued for try_number 2 2024-04-03T01:35:16.913665723Z [2024-04-03T01:35:16.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status success for try_number 1 2024-04-03T01:35:16.923064977Z [2024-04-03T01:35:16.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=-1, run_start_date=2024-04-03 01:35:15.188368+00:00, run_end_date=2024-04-03 01:35:15.575921+00:00, run_duration=0.387553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:13.056487+00:00, queued_by_job_id=1, pid=612 2024-04-03T01:35:16.923386326Z [2024-04-03T01:35:16.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ac80329-d2d4-4379-a09e-0e460d0f857a 2024-04-03T01:35:17.050745926Z [2024-04-03T01:35:17.050+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:35:17.050773193Z 2024-04-03T01:35:17.051023490Z [2024-04-03T01:35:17.050+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c has 0/16 running and queued tasks 2024-04-03T01:35:17.051692307Z [2024-04-03T01:35:17.051+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:35:17.051699358Z 2024-04-03T01:35:17.054340220Z [2024-04-03T01:35:17.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:34:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:35:17.054551260Z [2024-04-03T01:35:17.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:35:17.147972639Z [2024-04-03T01:35:17.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status queued for try_number 2 2024-04-03T01:35:17.156639404Z [2024-04-03T01:35:17.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a8a9ee3-b906-4b29-a241-b47d2e29adf4 2024-04-03T01:35:17.307618509Z [2024-04-03T01:35:17.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status failed for try_number 2 2024-04-03T01:35:17.315182370Z [2024-04-03T01:35:17.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-03 01:35:05.437072+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:15.578429+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:35:17.315706062Z [2024-04-03T01:35:17.315+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:17.317900066Z [2024-04-03T01:35:17.317+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:17.331800411Z [2024-04-03T01:35:17.331+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=extract_metrics_from_vnfrs, execution_date=20240403T013000, start_date=, end_date=20240403T013517 2024-04-03T01:35:19.555828097Z [2024-04-03T01:35:19.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status failed for try_number 2 2024-04-03T01:35:19.555928757Z [2024-04-03T01:35:19.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status failed for try_number 2 2024-04-03T01:35:19.565577944Z [2024-04-03T01:35:19.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-03 01:35:06.863512+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:17.052207+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:35:19.566114043Z [2024-04-03T01:35:19.565+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:19.568208730Z [2024-04-03T01:35:19.567+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:19.581313841Z [2024-04-03T01:35:19.580+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240403T013400, start_date=, end_date=20240403T013519 2024-04-03T01:35:19.589007886Z [2024-04-03T01:35:19.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-03 01:35:06.822688+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:35:16.862250+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:35:19.589547853Z [2024-04-03T01:35:19.589+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:19.592551661Z [2024-04-03T01:35:19.592+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:35:19.615140202Z [2024-04-03T01:35:19.614+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240403T013400, start_date=, end_date=20240403T013519 2024-04-03T01:35:19.769220302Z [2024-04-03T01:35:19.768+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T01:35:19.769637398Z [2024-04-03T01:35:19.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, execution_date=2024-04-03 01:34:00+00:00, run_id=scheduled__2024-04-03T01:34:00+00:00, run_start_date=2024-04-03 01:35:01.136240+00:00, run_end_date=2024-04-03 01:35:19.769095+00:00, run_duration=18.632855, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:34:00+00:00, data_interval_end=2024-04-03 01:35:00+00:00, dag_hash=2f5854b3dced90a2bce11e43ef89d5b7 2024-04-03T01:35:19.804941776Z [2024-04-03T01:35:19.801+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:36:00+00:00 2024-04-03T01:35:19.833705442Z [2024-04-03T01:35:19.833+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T01:35:19.833830980Z [2024-04-03T01:35:19.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, execution_date=2024-04-03 01:34:00+00:00, run_id=scheduled__2024-04-03T01:34:00+00:00, run_start_date=2024-04-03 01:35:01.137181+00:00, run_end_date=2024-04-03 01:35:19.833578+00:00, run_duration=18.696397, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:34:00+00:00, data_interval_end=2024-04-03 01:35:00+00:00, dag_hash=b8a0235e9ea3f7ed10db0c0838a53184 2024-04-03T01:35:19.893324364Z [2024-04-03T01:35:19.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:36:00+00:00 2024-04-03T01:35:20.896048232Z [2024-04-03T01:35:20.895+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T01:35:20.896652450Z [2024-04-03T01:35:20.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c, execution_date=2024-04-03 01:30:00+00:00, run_id=scheduled__2024-04-03T01:30:00+00:00, run_start_date=2024-04-03 01:35:01.133868+00:00, run_end_date=2024-04-03 01:35:20.896288+00:00, run_duration=19.76242, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:30:00+00:00, data_interval_end=2024-04-03 01:35:00+00:00, dag_hash=d80bc6a972b45b64b20e12f167f6b144 2024-04-03T01:35:20.904227476Z [2024-04-03T01:35:20.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:36:00.173283718Z [2024-04-03T01:36:00.172+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:36:00.184640249Z [2024-04-03T01:36:00.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:36:00+00:00, run_after=2024-04-03T01:37:00+00:00 2024-04-03T01:36:00.193408229Z [2024-04-03T01:36:00.193+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:36:00.249545186Z [2024-04-03T01:36:00.249+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:36:00.249576778Z 2024-04-03T01:36:00.249583543Z 2024-04-03T01:36:00.249589214Z 2024-04-03T01:36:00.249695767Z [2024-04-03T01:36:00.249+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:36:00.249890359Z [2024-04-03T01:36:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:36:00.250117472Z [2024-04-03T01:36:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:36:00.250776922Z [2024-04-03T01:36:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:36:00.250788732Z 2024-04-03T01:36:00.250793140Z 2024-04-03T01:36:00.250796823Z 2024-04-03T01:36:00.254997816Z [2024-04-03T01:36:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:36:00.255479643Z [2024-04-03T01:36:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:36:00.255819022Z [2024-04-03T01:36:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:36:00.256075865Z [2024-04-03T01:36:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:36:00.256310364Z [2024-04-03T01:36:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:36:00.256468359Z [2024-04-03T01:36:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:36:00.645524423Z [2024-04-03T01:36:00.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status queued for try_number 1 2024-04-03T01:36:00.645881846Z [2024-04-03T01:36:00.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 1 2024-04-03T01:36:00.645896607Z [2024-04-03T01:36:00.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 1 2024-04-03T01:36:00.657460830Z [2024-04-03T01:36:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d105ea0-6033-447a-9262-410b567e6a08 2024-04-03T01:36:00.657766440Z [2024-04-03T01:36:00.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2f91ff5-882b-4785-9559-657d0149fcdb 2024-04-03T01:36:00.658446545Z [2024-04-03T01:36:00.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to db72cbf1-7b71-4b2c-a963-01c5255043e9 2024-04-03T01:36:02.495638770Z [2024-04-03T01:36:02.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:36:02.496047060Z [2024-04-03T01:36:02.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:34:00+00:00, run_id=scheduled__2024-04-03T01:34:00+00:00, run_start_date=2024-04-03 01:36:00.202968+00:00, run_end_date=2024-04-03 01:36:02.495718+00:00, run_duration=2.29275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:34:00+00:00, data_interval_end=2024-04-03 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:36:02.504999147Z [2024-04-03T01:36:02.504+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:36:00+00:00, run_after=2024-04-03T01:38:00+00:00 2024-04-03T01:36:02.556797930Z [2024-04-03T01:36:02.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:34:00+00:00 exited with status success for try_number 1 2024-04-03T01:36:02.563899784Z [2024-04-03T01:36:02.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:34:00+00:00, map_index=-1, run_start_date=2024-04-03 01:36:01.260789+00:00, run_end_date=2024-04-03 01:36:01.898536+00:00, run_duration=0.637747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:36:00.252583+00:00, queued_by_job_id=1, pid=689 2024-04-03T01:36:04.703914579Z [2024-04-03T01:36:04.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:36:04.703939490Z [2024-04-03T01:36:04.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:35:00+00:00, run_id=scheduled__2024-04-03T01:35:00+00:00, run_start_date=2024-04-03 01:36:00.204079+00:00, run_end_date=2024-04-03 01:36:04.703556+00:00, run_duration=4.499477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:35:00+00:00, data_interval_end=2024-04-03 01:36:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:36:04.715569833Z [2024-04-03T01:36:04.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:36:00+00:00, run_after=2024-04-03T01:37:00+00:00 2024-04-03T01:36:04.723275218Z [2024-04-03T01:36:04.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:36:04.723353855Z [2024-04-03T01:36:04.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:35:00+00:00, run_id=scheduled__2024-04-03T01:35:00+00:00, run_start_date=2024-04-03 01:36:00.205061+00:00, run_end_date=2024-04-03 01:36:04.723071+00:00, run_duration=4.51801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:35:00+00:00, data_interval_end=2024-04-03 01:36:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:36:04.733953762Z [2024-04-03T01:36:04.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:36:00+00:00, run_after=2024-04-03T01:37:00+00:00 2024-04-03T01:36:04.766534652Z [2024-04-03T01:36:04.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status success for try_number 1 2024-04-03T01:36:04.766771307Z [2024-04-03T01:36:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status success for try_number 1 2024-04-03T01:36:04.785307189Z [2024-04-03T01:36:04.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=-1, run_start_date=2024-04-03 01:36:02.616628+00:00, run_end_date=2024-04-03 01:36:03.920423+00:00, run_duration=1.303795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:36:00.252583+00:00, queued_by_job_id=1, pid=720 2024-04-03T01:36:04.785453884Z [2024-04-03T01:36:04.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=-1, run_start_date=2024-04-03 01:36:02.587727+00:00, run_end_date=2024-04-03 01:36:04.374746+00:00, run_duration=1.787019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:36:00.252583+00:00, queued_by_job_id=1, pid=719 2024-04-03T01:36:34.857712596Z [2024-04-03T01:36:34.856+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T01:37:00.309241318Z [2024-04-03T01:37:00.308+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:37:00.321128715Z [2024-04-03T01:37:00.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:37:00+00:00, run_after=2024-04-03T01:38:00+00:00 2024-04-03T01:37:00.374606522Z [2024-04-03T01:37:00.374+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:37:00.374630441Z 2024-04-03T01:37:00.374634067Z 2024-04-03T01:37:00.375323838Z [2024-04-03T01:37:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:37:00.375909850Z [2024-04-03T01:37:00.375+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:37:00.377404801Z [2024-04-03T01:37:00.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:37:00.377415699Z 2024-04-03T01:37:00.377419208Z 2024-04-03T01:37:00.382641415Z [2024-04-03T01:37:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:37:00.383178573Z [2024-04-03T01:37:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:37:00.383712820Z [2024-04-03T01:37:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:37:00.384138021Z [2024-04-03T01:37:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:37:00.719834934Z [2024-04-03T01:37:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status queued for try_number 1 2024-04-03T01:37:00.720427033Z [2024-04-03T01:37:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status queued for try_number 1 2024-04-03T01:37:00.733154438Z [2024-04-03T01:37:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4592725-904e-485d-baba-252b9a0619fe 2024-04-03T01:37:00.734213549Z [2024-04-03T01:37:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ca25494-7475-43a2-8432-15574e484231 2024-04-03T01:37:03.339284064Z [2024-04-03T01:37:03.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:37:03.390775046Z [2024-04-03T01:37:03.386+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:37:03.390817414Z 2024-04-03T01:37:03.390826313Z [2024-04-03T01:37:03.387+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:37:03.390833594Z [2024-04-03T01:37:03.387+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:37:03.390858212Z 2024-04-03T01:37:03.390868868Z [2024-04-03T01:37:03.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:37:03.390875972Z [2024-04-03T01:37:03.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:37:03.454839807Z [2024-04-03T01:37:03.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:37:03.459515916Z [2024-04-03T01:37:03.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cd6c57e-d88d-4053-89fd-48b92f7dc04f 2024-04-03T01:37:05.706165638Z [2024-04-03T01:37:05.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:37:05.706619224Z [2024-04-03T01:37:05.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:36:00+00:00, run_id=scheduled__2024-04-03T01:36:00+00:00, run_start_date=2024-04-03 01:37:00.335369+00:00, run_end_date=2024-04-03 01:37:05.706004+00:00, run_duration=5.370635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:36:00+00:00, data_interval_end=2024-04-03 01:37:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:37:05.715919782Z [2024-04-03T01:37:05.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:37:00+00:00, run_after=2024-04-03T01:38:00+00:00 2024-04-03T01:37:05.722431046Z [2024-04-03T01:37:05.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:37:05.722799803Z [2024-04-03T01:37:05.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:36:00+00:00, run_id=scheduled__2024-04-03T01:36:00+00:00, run_start_date=2024-04-03 01:37:00.336507+00:00, run_end_date=2024-04-03 01:37:05.722474+00:00, run_duration=5.385967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:36:00+00:00, data_interval_end=2024-04-03 01:37:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:37:05.732732985Z [2024-04-03T01:37:05.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:37:00+00:00, run_after=2024-04-03T01:38:00+00:00 2024-04-03T01:37:05.756937975Z [2024-04-03T01:37:05.756+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:37:05.756956588Z 2024-04-03T01:37:05.757063609Z [2024-04-03T01:37:05.756+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:37:05.757567901Z [2024-04-03T01:37:05.757+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:37:05.757575059Z 2024-04-03T01:37:05.759438194Z [2024-04-03T01:37:05.759+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='split_metrics', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T01:37:05.759563230Z [2024-04-03T01:37:05.759+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'split_metrics', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:37:05.808520078Z [2024-04-03T01:37:05.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.split_metrics run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:37:05.808560423Z [2024-04-03T01:37:05.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status success for try_number 1 2024-04-03T01:37:05.808660688Z [2024-04-03T01:37:05.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status success for try_number 1 2024-04-03T01:37:05.808833784Z [2024-04-03T01:37:05.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status success for try_number 1 2024-04-03T01:37:05.821565192Z [2024-04-03T01:37:05.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:36:00+00:00, map_index=-1, run_start_date=2024-04-03 01:37:02.741755+00:00, run_end_date=2024-04-03 01:37:05.101779+00:00, run_duration=2.360024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:37:00.378988+00:00, queued_by_job_id=1, pid=773 2024-04-03T01:37:05.821862118Z [2024-04-03T01:37:05.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:36:00+00:00, map_index=-1, run_start_date=2024-04-03 01:37:02.745574+00:00, run_end_date=2024-04-03 01:37:05.047766+00:00, run_duration=2.302192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:37:00.378988+00:00, queued_by_job_id=1, pid=774 2024-04-03T01:37:05.822108834Z [2024-04-03T01:37:05.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dca108c-99ca-4849-9f0e-6067172224e7 2024-04-03T01:37:05.822288031Z [2024-04-03T01:37:05.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=-1, run_start_date=2024-04-03 01:37:05.078123+00:00, run_end_date=2024-04-03 01:37:05.377808+00:00, run_duration=0.299685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:37:03.388000+00:00, queued_by_job_id=1, pid=804 2024-04-03T01:37:08.460708381Z [2024-04-03T01:37:08.460+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:37:08.460738993Z 2024-04-03T01:37:08.460748974Z [2024-04-03T01:37:08.460+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:37:08.461231651Z [2024-04-03T01:37:08.461+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:37:08.461243272Z 2024-04-03T01:37:08.463092232Z [2024-04-03T01:37:08.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:37:08.463222938Z [2024-04-03T01:37:08.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'collect_metrics', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:37:08.507510919Z [2024-04-03T01:37:08.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.collect_metrics run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:37:08.507588698Z [2024-04-03T01:37:08.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.split_metrics run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status success for try_number 1 2024-04-03T01:37:08.516360447Z [2024-04-03T01:37:08.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=split_metrics, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=-1, run_start_date=2024-04-03 01:37:07.300140+00:00, run_end_date=2024-04-03 01:37:07.620510+00:00, run_duration=0.32037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:37:05.757885+00:00, queued_by_job_id=1, pid=824 2024-04-03T01:37:08.516462471Z [2024-04-03T01:37:08.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfc18b9c-f763-440b-8ef4-cd158ad1e6f1 2024-04-03T01:37:10.707867675Z [2024-04-03T01:37:10.707+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:37:10.707911965Z 2024-04-03T01:37:10.707972316Z [2024-04-03T01:37:10.707+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:37:10.708447075Z [2024-04-03T01:37:10.708+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:37:10.708465512Z 2024-04-03T01:37:10.710300916Z [2024-04-03T01:37:10.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='send_prometheus', run_id='scheduled__2024-04-03T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:37:10.710376450Z [2024-04-03T01:37:10.710+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'send_prometheus', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:37:10.758696006Z [2024-04-03T01:37:10.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.send_prometheus run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status queued for try_number 1 2024-04-03T01:37:10.759462368Z [2024-04-03T01:37:10.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.collect_metrics run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status success for try_number 1 2024-04-03T01:37:10.768098207Z [2024-04-03T01:37:10.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef2e004d-1659-41c9-937a-223849b622d5 2024-04-03T01:37:10.768361841Z [2024-04-03T01:37:10.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=0, run_start_date=2024-04-03 01:37:10.099237+00:00, run_end_date=2024-04-03 01:37:10.372151+00:00, run_duration=0.272914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:37:08.461466+00:00, queued_by_job_id=1, pid=836 2024-04-03T01:37:13.565826449Z [2024-04-03T01:37:13.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:37:13.566506628Z [2024-04-03T01:37:13.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:30:00+00:00, run_id=scheduled__2024-04-03T01:30:00+00:00, run_start_date=2024-04-03 01:37:03.347469+00:00, run_end_date=2024-04-03 01:37:13.565748+00:00, run_duration=10.218279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:30:00+00:00, data_interval_end=2024-04-03 01:35:00+00:00, dag_hash=f2b47457475a1364440f1202ec747ebf 2024-04-03T01:37:13.572476317Z [2024-04-03T01:37:13.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:35:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:37:13.608735048Z [2024-04-03T01:37:13.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.send_prometheus run_id=scheduled__2024-04-03T01:30:00+00:00 exited with status success for try_number 1 2024-04-03T01:37:13.613518851Z [2024-04-03T01:37:13.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=send_prometheus, run_id=scheduled__2024-04-03T01:30:00+00:00, map_index=-1, run_start_date=2024-04-03 01:37:12.398039+00:00, run_end_date=2024-04-03 01:37:12.693553+00:00, run_duration=0.295514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:37:10.708697+00:00, queued_by_job_id=1, pid=848 2024-04-03T01:37:28.768546028Z [2024-04-03T01:37:28.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:37:28.803737107Z [2024-04-03T01:37:28.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:37:00+00:00, run_after=2024-04-03T01:38:00+00:00 2024-04-03T01:37:28.849606070Z [2024-04-03T01:37:28.849+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:37:28.849644615Z 2024-04-03T01:37:28.849653431Z 2024-04-03T01:37:28.849675828Z [2024-04-03T01:37:28.849+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:37:28.849684264Z [2024-04-03T01:37:28.849+0000] {scheduler_job.py:425} INFO - DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:37:28.850187826Z [2024-04-03T01:37:28.849+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:37:28.850208438Z 2024-04-03T01:37:28.850211963Z 2024-04-03T01:37:28.853324787Z [2024-04-03T01:37:28.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:37:28.853383526Z [2024-04-03T01:37:28.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:37:28.853621967Z [2024-04-03T01:37:28.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:37:28.853727956Z [2024-04-03T01:37:28.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:37:29.030928594Z [2024-04-03T01:37:29.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status queued for try_number 1 2024-04-03T01:37:29.031060778Z [2024-04-03T01:37:29.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status queued for try_number 1 2024-04-03T01:37:29.049524995Z [2024-04-03T01:37:29.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f4faac3-5818-48b8-a2e0-a7a3662a0125 2024-04-03T01:37:29.050322972Z [2024-04-03T01:37:29.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to cef3a518-eb4f-41c3-915e-23ded9a7d72f 2024-04-03T01:37:32.452582840Z [2024-04-03T01:37:32.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:37:32.452946238Z [2024-04-03T01:37:32.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:36:00+00:00, run_id=scheduled__2024-04-03T01:36:00+00:00, run_start_date=2024-04-03 01:37:28.814837+00:00, run_end_date=2024-04-03 01:37:32.452411+00:00, run_duration=3.637574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:36:00+00:00, data_interval_end=2024-04-03 01:37:00+00:00, dag_hash=d424bd1c08f3a998735d85eada0d3e47 2024-04-03T01:37:32.463009492Z [2024-04-03T01:37:32.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:37:00+00:00, run_after=2024-04-03T01:38:00+00:00 2024-04-03T01:37:32.502253430Z [2024-04-03T01:37:32.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status success for try_number 1 2024-04-03T01:37:32.513327528Z [2024-04-03T01:37:32.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:36:00+00:00, map_index=-1, run_start_date=2024-04-03 01:37:30.677178+00:00, run_end_date=2024-04-03 01:37:31.983572+00:00, run_duration=1.306394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:37:28.850628+00:00, queued_by_job_id=1, pid=884 2024-04-03T01:37:32.791399134Z [2024-04-03T01:37:32.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:37:32.798483463Z [2024-04-03T01:37:32.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:36:00+00:00, run_id=scheduled__2024-04-03T01:36:00+00:00, run_start_date=2024-04-03 01:37:28.814339+00:00, run_end_date=2024-04-03 01:37:32.791338+00:00, run_duration=3.976999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:36:00+00:00, data_interval_end=2024-04-03 01:37:00+00:00, dag_hash=9a8d607a43d1345c617993cedbd2a975 2024-04-03T01:37:32.809897087Z [2024-04-03T01:37:32.809+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:37:00+00:00, run_after=2024-04-03T01:38:00+00:00 2024-04-03T01:37:32.848748048Z [2024-04-03T01:37:32.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status success for try_number 1 2024-04-03T01:37:32.853223174Z [2024-04-03T01:37:32.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:36:00+00:00, map_index=-1, run_start_date=2024-04-03 01:37:30.710495+00:00, run_end_date=2024-04-03 01:37:32.515310+00:00, run_duration=1.804815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:37:28.850628+00:00, queued_by_job_id=1, pid=885 2024-04-03T01:38:00.250202460Z [2024-04-03T01:38:00.249+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:38:00.266686446Z [2024-04-03T01:38:00.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:38:00+00:00, run_after=2024-04-03T01:39:00+00:00 2024-04-03T01:38:00.278651973Z [2024-04-03T01:38:00.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:38:00+00:00, run_after=2024-04-03T01:39:00+00:00 2024-04-03T01:38:00.285629566Z [2024-04-03T01:38:00.285+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:38:00.291808221Z [2024-04-03T01:38:00.291+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:38:00.400110484Z [2024-04-03T01:38:00.399+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-03T01:38:00.400144863Z 2024-04-03T01:38:00.400149219Z 2024-04-03T01:38:00.400153045Z 2024-04-03T01:38:00.400156036Z 2024-04-03T01:38:00.400159043Z 2024-04-03T01:38:00.400402927Z [2024-04-03T01:38:00.400+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:38:00.400640199Z [2024-04-03T01:38:00.400+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:38:00.400822015Z [2024-04-03T01:38:00.400+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:38:00.401066200Z [2024-04-03T01:38:00.400+0000] {scheduler_job.py:425} INFO - DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:38:00.401255163Z [2024-04-03T01:38:00.401+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:38:00.401961167Z [2024-04-03T01:38:00.401+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:38:00.401973037Z 2024-04-03T01:38:00.401992265Z 2024-04-03T01:38:00.401995445Z 2024-04-03T01:38:00.401998369Z 2024-04-03T01:38:00.402001711Z 2024-04-03T01:38:00.406722287Z [2024-04-03T01:38:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:38:00.407218629Z [2024-04-03T01:38:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:38:00.407544371Z [2024-04-03T01:38:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:38:00.407742949Z [2024-04-03T01:38:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:38:00.408541141Z [2024-04-03T01:38:00.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:38:00.408768325Z [2024-04-03T01:38:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:38:00.409120328Z [2024-04-03T01:38:00.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:38:00.409537418Z [2024-04-03T01:38:00.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:38:00.409880230Z [2024-04-03T01:38:00.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:38:00.410109300Z [2024-04-03T01:38:00.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:38:00.919019245Z [2024-04-03T01:38:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status queued for try_number 1 2024-04-03T01:38:00.919116943Z [2024-04-03T01:38:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:37:00+00:00 exited with status queued for try_number 1 2024-04-03T01:38:00.919124084Z [2024-04-03T01:38:00.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:37:00+00:00 exited with status queued for try_number 1 2024-04-03T01:38:00.919199071Z [2024-04-03T01:38:00.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:37:00+00:00 exited with status queued for try_number 1 2024-04-03T01:38:00.919228688Z [2024-04-03T01:38:00.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:37:00+00:00 exited with status queued for try_number 1 2024-04-03T01:38:00.933106986Z [2024-04-03T01:38:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc7c7963-136b-4a6f-9f80-b877bae8bed4 2024-04-03T01:38:00.933189189Z [2024-04-03T01:38:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49f6c099-6f9b-457c-86a3-6cad18ff4c18 2024-04-03T01:38:00.933282616Z [2024-04-03T01:38:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 517eb963-860a-40ce-a451-21dbd6c09e40 2024-04-03T01:38:00.933380532Z [2024-04-03T01:38:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to b912c30f-2960-49ca-9bac-116ec57c74b1 2024-04-03T01:38:00.933474318Z [2024-04-03T01:38:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6a559a9-b702-4684-a1f4-2b6bd41177c6 2024-04-03T01:38:03.262534759Z [2024-04-03T01:38:03.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:38:03.264083713Z [2024-04-03T01:38:03.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:36:00+00:00, run_id=scheduled__2024-04-03T01:36:00+00:00, run_start_date=2024-04-03 01:38:00.312775+00:00, run_end_date=2024-04-03 01:38:03.262471+00:00, run_duration=2.949696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:36:00+00:00, data_interval_end=2024-04-03 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:38:03.273765635Z [2024-04-03T01:38:03.273+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:38:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:38:03.439898110Z [2024-04-03T01:38:03.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:36:00+00:00 exited with status success for try_number 1 2024-04-03T01:38:03.445590922Z [2024-04-03T01:38:03.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:36:00+00:00, map_index=-1, run_start_date=2024-04-03 01:38:02.389050+00:00, run_end_date=2024-04-03 01:38:02.774095+00:00, run_duration=0.385045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:38:00.403078+00:00, queued_by_job_id=1, pid=911 2024-04-03T01:38:05.689420520Z [2024-04-03T01:38:05.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:38:05.690457444Z [2024-04-03T01:38:05.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:37:00+00:00, run_id=scheduled__2024-04-03T01:37:00+00:00, run_start_date=2024-04-03 01:38:00.315406+00:00, run_end_date=2024-04-03 01:38:05.689297+00:00, run_duration=5.373891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:37:00+00:00, data_interval_end=2024-04-03 01:38:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:38:05.714232335Z [2024-04-03T01:38:05.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:38:00+00:00, run_after=2024-04-03T01:39:00+00:00 2024-04-03T01:38:05.722839430Z [2024-04-03T01:38:05.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:38:05.723220877Z [2024-04-03T01:38:05.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:37:00+00:00, run_id=scheduled__2024-04-03T01:37:00+00:00, run_start_date=2024-04-03 01:38:00.318969+00:00, run_end_date=2024-04-03 01:38:05.722762+00:00, run_duration=5.403793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:37:00+00:00, data_interval_end=2024-04-03 01:38:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:38:05.735213670Z [2024-04-03T01:38:05.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:38:00+00:00, run_after=2024-04-03T01:39:00+00:00 2024-04-03T01:38:05.797261045Z [2024-04-03T01:38:05.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:37:00+00:00 exited with status success for try_number 1 2024-04-03T01:38:05.803448365Z [2024-04-03T01:38:05.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:37:00+00:00, map_index=-1, run_start_date=2024-04-03 01:38:03.568551+00:00, run_end_date=2024-04-03 01:38:05.286161+00:00, run_duration=1.71761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:38:00.403078+00:00, queued_by_job_id=1, pid=951 2024-04-03T01:38:06.853314426Z [2024-04-03T01:38:06.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:38:06.853804056Z [2024-04-03T01:38:06.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:37:00+00:00, run_id=scheduled__2024-04-03T01:37:00+00:00, run_start_date=2024-04-03 01:38:00.320817+00:00, run_end_date=2024-04-03 01:38:06.853473+00:00, run_duration=6.532656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:37:00+00:00, data_interval_end=2024-04-03 01:38:00+00:00, dag_hash=d424bd1c08f3a998735d85eada0d3e47 2024-04-03T01:38:06.862254094Z [2024-04-03T01:38:06.862+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:38:00+00:00, run_after=2024-04-03T01:39:00+00:00 2024-04-03T01:38:06.868199591Z [2024-04-03T01:38:06.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:38:06.869323379Z [2024-04-03T01:38:06.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:37:00+00:00, run_id=scheduled__2024-04-03T01:37:00+00:00, run_start_date=2024-04-03 01:38:00.322314+00:00, run_end_date=2024-04-03 01:38:06.868941+00:00, run_duration=6.546627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:37:00+00:00, data_interval_end=2024-04-03 01:38:00+00:00, dag_hash=9a8d607a43d1345c617993cedbd2a975 2024-04-03T01:38:06.878178324Z [2024-04-03T01:38:06.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:38:00+00:00, run_after=2024-04-03T01:39:00+00:00 2024-04-03T01:38:06.917647877Z [2024-04-03T01:38:06.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:37:00+00:00 exited with status success for try_number 1 2024-04-03T01:38:06.917973481Z [2024-04-03T01:38:06.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:37:00+00:00 exited with status success for try_number 1 2024-04-03T01:38:06.918286176Z [2024-04-03T01:38:06.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:37:00+00:00 exited with status success for try_number 1 2024-04-03T01:38:06.926522475Z [2024-04-03T01:38:06.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:37:00+00:00, map_index=-1, run_start_date=2024-04-03 01:38:03.104500+00:00, run_end_date=2024-04-03 01:38:05.629076+00:00, run_duration=2.524576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:38:00.403078+00:00, queued_by_job_id=1, pid=932 2024-04-03T01:38:06.927010375Z [2024-04-03T01:38:06.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:37:00+00:00, map_index=-1, run_start_date=2024-04-03 01:38:04.170297+00:00, run_end_date=2024-04-03 01:38:06.618857+00:00, run_duration=2.44856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:38:00.403078+00:00, queued_by_job_id=1, pid=978 2024-04-03T01:38:06.927432938Z [2024-04-03T01:38:06.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:37:00+00:00, map_index=-1, run_start_date=2024-04-03 01:38:04.001841+00:00, run_end_date=2024-04-03 01:38:06.673308+00:00, run_duration=2.671467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:38:00.403078+00:00, queued_by_job_id=1, pid=970 2024-04-03T01:39:00.134319191Z [2024-04-03T01:39:00.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:39:00.144768528Z [2024-04-03T01:39:00.142+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:39:00.179082677Z [2024-04-03T01:39:00.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:39:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:39:00.218115179Z [2024-04-03T01:39:00.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:39:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:39:00.324598988Z [2024-04-03T01:39:00.324+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T01:39:00.324634590Z 2024-04-03T01:39:00.324638346Z 2024-04-03T01:39:00.324641758Z 2024-04-03T01:39:00.324645001Z 2024-04-03T01:39:00.324655896Z [2024-04-03T01:39:00.324+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:39:00.324777272Z [2024-04-03T01:39:00.324+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:39:00.324912897Z [2024-04-03T01:39:00.324+0000] {scheduler_job.py:425} INFO - DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:39:00.325083559Z [2024-04-03T01:39:00.324+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:39:00.325777498Z [2024-04-03T01:39:00.325+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:39:00.325796570Z 2024-04-03T01:39:00.325800323Z 2024-04-03T01:39:00.325829599Z 2024-04-03T01:39:00.325833066Z 2024-04-03T01:39:00.330014659Z [2024-04-03T01:39:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:39:00.331284382Z [2024-04-03T01:39:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:39:00.331564726Z [2024-04-03T01:39:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:39:00.331722046Z [2024-04-03T01:39:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:39:00.331951209Z [2024-04-03T01:39:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:39:00.332055565Z [2024-04-03T01:39:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:39:00.332385072Z [2024-04-03T01:39:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:39:00.332564412Z [2024-04-03T01:39:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:39:00.889004655Z [2024-04-03T01:39:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status queued for try_number 1 2024-04-03T01:39:00.889037130Z [2024-04-03T01:39:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status queued for try_number 1 2024-04-03T01:39:00.890500784Z [2024-04-03T01:39:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status queued for try_number 1 2024-04-03T01:39:00.890526478Z [2024-04-03T01:39:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status queued for try_number 1 2024-04-03T01:39:00.913762449Z [2024-04-03T01:39:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6903a49f-e464-4762-83a4-7162869e9b53 2024-04-03T01:39:00.917534037Z [2024-04-03T01:39:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f1bd438-240c-4c52-b729-0f732cc798eb 2024-04-03T01:39:00.917727286Z [2024-04-03T01:39:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to d689d9f8-0b8b-4ae6-a516-ce187515d7ea 2024-04-03T01:39:00.917883317Z [2024-04-03T01:39:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7cb3d81-2f53-4a15-8e29-ee204ae645d2 2024-04-03T01:39:08.851681867Z [2024-04-03T01:39:08.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:39:08.851914086Z [2024-04-03T01:39:08.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:38:00+00:00, run_id=scheduled__2024-04-03T01:38:00+00:00, run_start_date=2024-04-03 01:39:00.233421+00:00, run_end_date=2024-04-03 01:39:08.851520+00:00, run_duration=8.618099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:38:00+00:00, data_interval_end=2024-04-03 01:39:00+00:00, dag_hash=d424bd1c08f3a998735d85eada0d3e47 2024-04-03T01:39:08.865501836Z [2024-04-03T01:39:08.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:39:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:39:08.872551026Z [2024-04-03T01:39:08.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:39:08.872684095Z [2024-04-03T01:39:08.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:38:00+00:00, run_id=scheduled__2024-04-03T01:38:00+00:00, run_start_date=2024-04-03 01:39:00.234399+00:00, run_end_date=2024-04-03 01:39:08.872404+00:00, run_duration=8.638005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:38:00+00:00, data_interval_end=2024-04-03 01:39:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:39:08.881699298Z [2024-04-03T01:39:08.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:39:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:39:08.888272267Z [2024-04-03T01:39:08.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:39:08.888423842Z [2024-04-03T01:39:08.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:38:00+00:00, run_id=scheduled__2024-04-03T01:38:00+00:00, run_start_date=2024-04-03 01:39:00.230885+00:00, run_end_date=2024-04-03 01:39:08.888179+00:00, run_duration=8.657294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:38:00+00:00, data_interval_end=2024-04-03 01:39:00+00:00, dag_hash=9a8d607a43d1345c617993cedbd2a975 2024-04-03T01:39:08.897032632Z [2024-04-03T01:39:08.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:39:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:39:08.925829899Z [2024-04-03T01:39:08.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status success for try_number 1 2024-04-03T01:39:08.925919768Z [2024-04-03T01:39:08.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status success for try_number 1 2024-04-03T01:39:08.925928996Z [2024-04-03T01:39:08.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status success for try_number 1 2024-04-03T01:39:08.931527232Z [2024-04-03T01:39:08.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:38:00+00:00, map_index=-1, run_start_date=2024-04-03 01:39:04.501482+00:00, run_end_date=2024-04-03 01:39:07.879650+00:00, run_duration=3.378168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:39:00.326526+00:00, queued_by_job_id=1, pid=1059 2024-04-03T01:39:08.931640467Z [2024-04-03T01:39:08.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:38:00+00:00, map_index=-1, run_start_date=2024-04-03 01:39:04.420110+00:00, run_end_date=2024-04-03 01:39:07.995429+00:00, run_duration=3.575319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:39:00.326526+00:00, queued_by_job_id=1, pid=1058 2024-04-03T01:39:08.931783619Z [2024-04-03T01:39:08.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:38:00+00:00, map_index=-1, run_start_date=2024-04-03 01:39:05.564477+00:00, run_end_date=2024-04-03 01:39:08.600292+00:00, run_duration=3.035815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:39:00.326526+00:00, queued_by_job_id=1, pid=1087 2024-04-03T01:39:09.467862843Z [2024-04-03T01:39:09.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:39:09.467988321Z [2024-04-03T01:39:09.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:38:00+00:00, run_id=scheduled__2024-04-03T01:38:00+00:00, run_start_date=2024-04-03 01:39:00.232298+00:00, run_end_date=2024-04-03 01:39:09.467750+00:00, run_duration=9.235452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:38:00+00:00, data_interval_end=2024-04-03 01:39:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:39:09.476751014Z [2024-04-03T01:39:09.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:39:00+00:00, run_after=2024-04-03T01:40:00+00:00 2024-04-03T01:39:09.500547096Z [2024-04-03T01:39:09.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status success for try_number 1 2024-04-03T01:39:09.505926905Z [2024-04-03T01:39:09.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:38:00+00:00, map_index=-1, run_start_date=2024-04-03 01:39:03.941047+00:00, run_end_date=2024-04-03 01:39:09.101689+00:00, run_duration=5.160642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:39:00.326526+00:00, queued_by_job_id=1, pid=1048 2024-04-03T01:40:00.173275542Z [2024-04-03T01:40:00.172+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:40:00.209408516Z [2024-04-03T01:40:00.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:45:00+00:00 2024-04-03T01:40:00.231226147Z [2024-04-03T01:40:00.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:41:00+00:00 2024-04-03T01:40:00.260159020Z [2024-04-03T01:40:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:41:00+00:00 2024-04-03T01:40:00.270187028Z [2024-04-03T01:40:00.269+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:40:00.278880510Z [2024-04-03T01:40:00.278+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:40:00.290832459Z [2024-04-03T01:40:00.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:45:00+00:00 2024-04-03T01:40:00.403504472Z [2024-04-03T01:40:00.403+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-04-03T01:40:00.403530514Z 2024-04-03T01:40:00.403533800Z 2024-04-03T01:40:00.403536852Z 2024-04-03T01:40:00.403540420Z 2024-04-03T01:40:00.403555870Z 2024-04-03T01:40:00.403558689Z 2024-04-03T01:40:00.403561513Z 2024-04-03T01:40:00.403577121Z [2024-04-03T01:40:00.403+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:40:00.403813312Z [2024-04-03T01:40:00.403+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:40:00.404177645Z [2024-04-03T01:40:00.404+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:40:00.404300687Z [2024-04-03T01:40:00.404+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:40:00.404428871Z [2024-04-03T01:40:00.404+0000] {scheduler_job.py:425} INFO - DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:40:00.404565998Z [2024-04-03T01:40:00.404+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:40:00.404675913Z [2024-04-03T01:40:00.404+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:40:00.405300315Z [2024-04-03T01:40:00.405+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:40:00.405310925Z 2024-04-03T01:40:00.405314369Z 2024-04-03T01:40:00.405318034Z 2024-04-03T01:40:00.405321357Z 2024-04-03T01:40:00.405324425Z 2024-04-03T01:40:00.405327429Z 2024-04-03T01:40:00.405330529Z 2024-04-03T01:40:00.410437630Z [2024-04-03T01:40:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:40:00.410617418Z [2024-04-03T01:40:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:00.410830687Z [2024-04-03T01:40:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:40:00.410963667Z [2024-04-03T01:40:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:00.411197871Z [2024-04-03T01:40:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:40:00.411319167Z [2024-04-03T01:40:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:40:00.411558797Z [2024-04-03T01:40:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:40:00.411695020Z [2024-04-03T01:40:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:40:00.411894451Z [2024-04-03T01:40:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:40:00.412011516Z [2024-04-03T01:40:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:40:00.412201421Z [2024-04-03T01:40:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:40:00.412316785Z [2024-04-03T01:40:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:40:00.412505934Z [2024-04-03T01:40:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:40:00.412625100Z [2024-04-03T01:40:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:40:01.190085094Z [2024-04-03T01:40:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:01.190616908Z [2024-04-03T01:40:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:01.190958220Z [2024-04-03T01:40:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:01.191190626Z [2024-04-03T01:40:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:39:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:01.191412796Z [2024-04-03T01:40:01.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:39:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:01.191639179Z [2024-04-03T01:40:01.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:39:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:01.191870452Z [2024-04-03T01:40:01.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:39:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:01.209352256Z [2024-04-03T01:40:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d7064ea-b6cb-4383-8b44-f67200164b08 2024-04-03T01:40:01.209603015Z [2024-04-03T01:40:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cedc2ea-ba51-40a6-8647-5cfba6f8c9fa 2024-04-03T01:40:01.209901311Z [2024-04-03T01:40:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e575860-e33f-404d-a3ce-52cda22a7046 2024-04-03T01:40:01.210115586Z [2024-04-03T01:40:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95dced54-440c-4fcd-9c38-1512a2ef2f1b 2024-04-03T01:40:01.210326950Z [2024-04-03T01:40:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94a2b9e5-b456-4654-9de4-a9e7fe349900 2024-04-03T01:40:01.210533672Z [2024-04-03T01:40:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to 411f6867-547f-4e40-a0f7-d2ab34122a7e 2024-04-03T01:40:01.210835748Z [2024-04-03T01:40:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04ec1ff3-ccc3-42cd-a943-b0085e093d59 2024-04-03T01:40:03.689119307Z [2024-04-03T01:40:03.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:40:03.690030731Z [2024-04-03T01:40:03.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:38:00+00:00, run_id=scheduled__2024-04-03T01:38:00+00:00, run_start_date=2024-04-03 01:40:00.305264+00:00, run_end_date=2024-04-03 01:40:03.688966+00:00, run_duration=3.383702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:38:00+00:00, data_interval_end=2024-04-03 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:40:03.699862029Z [2024-04-03T01:40:03.699+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:42:00+00:00 2024-04-03T01:40:03.844242222Z [2024-04-03T01:40:03.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:38:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:03.859875334Z [2024-04-03T01:40:03.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:38:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:02.487360+00:00, run_end_date=2024-04-03 01:40:03.160258+00:00, run_duration=0.672898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:00.406541+00:00, queued_by_job_id=1, pid=1118 2024-04-03T01:40:06.290140911Z [2024-04-03T01:40:06.289+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:40:06.290165217Z 2024-04-03T01:40:06.294989009Z [2024-04-03T01:40:06.290+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:40:06.296317880Z [2024-04-03T01:40:06.295+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:40:06.296332758Z 2024-04-03T01:40:06.315983745Z [2024-04-03T01:40:06.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='split_metrics', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T01:40:06.320925566Z [2024-04-03T01:40:06.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'split_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:06.426068062Z [2024-04-03T01:40:06.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.split_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:06.426229681Z [2024-04-03T01:40:06.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:06.438473819Z [2024-04-03T01:40:06.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:04.337837+00:00, run_end_date=2024-04-03 01:40:04.993533+00:00, run_duration=0.655696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:00.406541+00:00, queued_by_job_id=1, pid=1142 2024-04-03T01:40:06.440828390Z [2024-04-03T01:40:06.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to 225696c0-73cd-4645-a1ee-fcab006e4509 2024-04-03T01:40:06.604664268Z [2024-04-03T01:40:06.604+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:40:06.604685005Z 2024-04-03T01:40:06.604997769Z [2024-04-03T01:40:06.604+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:40:06.605923778Z [2024-04-03T01:40:06.605+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:40:06.605935568Z 2024-04-03T01:40:06.618787686Z [2024-04-03T01:40:06.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T01:40:06.618810350Z [2024-04-03T01:40:06.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:06.730360037Z [2024-04-03T01:40:06.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:06.731789575Z [2024-04-03T01:40:06.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:06.742059232Z [2024-04-03T01:40:06.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:05.820350+00:00, run_end_date=2024-04-03 01:40:06.264060+00:00, run_duration=0.44371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:00.406541+00:00, queued_by_job_id=1, pid=1224 2024-04-03T01:40:06.742485542Z [2024-04-03T01:40:06.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e4e161f-b26d-420b-9719-0796675e65a2 2024-04-03T01:40:07.996718410Z [2024-04-03T01:40:07.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:40:08.004292912Z [2024-04-03T01:40:08.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:39:00+00:00, run_id=scheduled__2024-04-03T01:39:00+00:00, run_start_date=2024-04-03 01:40:00.307395+00:00, run_end_date=2024-04-03 01:40:07.996609+00:00, run_duration=7.689214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:39:00+00:00, data_interval_end=2024-04-03 01:40:00+00:00, dag_hash=d424bd1c08f3a998735d85eada0d3e47 2024-04-03T01:40:08.032246660Z [2024-04-03T01:40:08.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:41:00+00:00 2024-04-03T01:40:08.166184141Z [2024-04-03T01:40:08.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:39:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:08.174807183Z [2024-04-03T01:40:08.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:39:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:05.173119+00:00, run_end_date=2024-04-03 01:40:07.626484+00:00, run_duration=2.453365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:00.406541+00:00, queued_by_job_id=1, pid=1171 2024-04-03T01:40:09.153675480Z [2024-04-03T01:40:09.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:40:09.153696983Z [2024-04-03T01:40:09.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:39:00+00:00, run_id=scheduled__2024-04-03T01:39:00+00:00, run_start_date=2024-04-03 01:40:00.308412+00:00, run_end_date=2024-04-03 01:40:09.153242+00:00, run_duration=8.84483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:39:00+00:00, data_interval_end=2024-04-03 01:40:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:40:09.170046094Z [2024-04-03T01:40:09.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:41:00+00:00 2024-04-03T01:40:09.298047120Z [2024-04-03T01:40:09.295+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:40:09.298097390Z 2024-04-03T01:40:09.298101370Z [2024-04-03T01:40:09.296+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:40:09.298106118Z [2024-04-03T01:40:09.296+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:40:09.298109348Z 2024-04-03T01:40:09.300010489Z [2024-04-03T01:40:09.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:40:09.300021351Z [2024-04-03T01:40:09.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'collect_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:40:09.407272403Z [2024-04-03T01:40:09.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.collect_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:09.407413998Z [2024-04-03T01:40:09.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:39:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:09.407544555Z [2024-04-03T01:40:09.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.split_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:09.424911598Z [2024-04-03T01:40:09.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=split_metrics, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:08.483189+00:00, run_end_date=2024-04-03 01:40:08.930044+00:00, run_duration=0.446855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:06.298953+00:00, queued_by_job_id=1, pid=1259 2024-04-03T01:40:09.425135953Z [2024-04-03T01:40:09.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8ad60b3-5f43-4184-b897-e2e90fd1e641 2024-04-03T01:40:09.425324113Z [2024-04-03T01:40:09.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:39:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:05.535220+00:00, run_end_date=2024-04-03 01:40:08.053125+00:00, run_duration=2.517905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:00.406541+00:00, queued_by_job_id=1, pid=1207 2024-04-03T01:40:09.502486797Z [2024-04-03T01:40:09.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:40:09.502514688Z [2024-04-03T01:40:09.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:39:00+00:00, run_id=scheduled__2024-04-03T01:39:00+00:00, run_start_date=2024-04-03 01:40:00.306313+00:00, run_end_date=2024-04-03 01:40:09.501396+00:00, run_duration=9.195083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:39:00+00:00, data_interval_end=2024-04-03 01:40:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:40:09.516032052Z [2024-04-03T01:40:09.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:41:00+00:00 2024-04-03T01:40:09.523185116Z [2024-04-03T01:40:09.522+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:40:09.523433102Z [2024-04-03T01:40:09.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:39:00+00:00, run_id=scheduled__2024-04-03T01:39:00+00:00, run_start_date=2024-04-03 01:40:00.309454+00:00, run_end_date=2024-04-03 01:40:09.523183+00:00, run_duration=9.213729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:39:00+00:00, data_interval_end=2024-04-03 01:40:00+00:00, dag_hash=9a8d607a43d1345c617993cedbd2a975 2024-04-03T01:40:09.533841577Z [2024-04-03T01:40:09.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:41:00+00:00 2024-04-03T01:40:09.580195885Z [2024-04-03T01:40:09.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:39:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:09.580370593Z [2024-04-03T01:40:09.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:39:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:09.587188872Z [2024-04-03T01:40:09.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:39:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:05.741896+00:00, run_end_date=2024-04-03 01:40:09.318874+00:00, run_duration=3.576978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:00.406541+00:00, queued_by_job_id=1, pid=1208 2024-04-03T01:40:09.587415332Z [2024-04-03T01:40:09.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:39:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:05.128127+00:00, run_end_date=2024-04-03 01:40:09.326495+00:00, run_duration=4.198368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:00.406541+00:00, queued_by_job_id=1, pid=1170 2024-04-03T01:40:10.668719453Z [2024-04-03T01:40:10.668+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:40:10.668751326Z 2024-04-03T01:40:10.669016613Z [2024-04-03T01:40:10.668+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:40:10.669809589Z [2024-04-03T01:40:10.669+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:40:10.669821477Z 2024-04-03T01:40:10.672234539Z [2024-04-03T01:40:10.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:40:10.672459561Z [2024-04-03T01:40:10.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:40:10.750315629Z [2024-04-03T01:40:10.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:10.750392331Z [2024-04-03T01:40:10.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:10.760465301Z [2024-04-03T01:40:10.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:08.874122+00:00, run_end_date=2024-04-03 01:40:09.358031+00:00, run_duration=0.483909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:06.609691+00:00, queued_by_job_id=1, pid=1269 2024-04-03T01:40:10.760917010Z [2024-04-03T01:40:10.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to a83223db-9c06-4690-97c3-d625539c6564 2024-04-03T01:40:11.564989623Z [2024-04-03T01:40:11.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.collect_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status failed for try_number 1 2024-04-03T01:40:11.572791833Z [2024-04-03T01:40:11.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=0, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:09.297170+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:40:11.573375189Z [2024-04-03T01:40:11.573+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:40:11.575890412Z [2024-04-03T01:40:11.575+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:40:11.591728531Z [2024-04-03T01:40:11.591+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=collect_metrics, map_index=0, execution_date=20240403T013500, start_date=, end_date=20240403T014011 2024-04-03T01:40:13.981324001Z [2024-04-03T01:40:13.980+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:40:13.981349421Z 2024-04-03T01:40:13.981701813Z [2024-04-03T01:40:13.981+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:40:13.982260693Z [2024-04-03T01:40:13.982+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:40:13.982286534Z 2024-04-03T01:40:13.984549552Z [2024-04-03T01:40:13.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:40:13.984782047Z [2024-04-03T01:40:13.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:14.111596747Z [2024-04-03T01:40:14.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 1 2024-04-03T01:40:14.113884321Z [2024-04-03T01:40:14.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:14.158471405Z [2024-04-03T01:40:14.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=0, run_start_date=2024-04-03 01:40:12.614823+00:00, run_end_date=2024-04-03 01:40:13.058585+00:00, run_duration=0.443762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:10.670286+00:00, queued_by_job_id=1, pid=1301 2024-04-03T01:40:14.161097688Z [2024-04-03T01:40:14.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1937c548-37d0-45f0-9e9c-7b477e827e6c 2024-04-03T01:40:16.644789012Z [2024-04-03T01:40:16.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:40:16.644824560Z [2024-04-03T01:40:16.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:35:00+00:00, run_id=scheduled__2024-04-03T01:35:00+00:00, run_start_date=2024-04-03 01:40:00.304107+00:00, run_end_date=2024-04-03 01:40:16.643728+00:00, run_duration=16.339621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:35:00+00:00, data_interval_end=2024-04-03 01:40:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T01:40:16.651590655Z [2024-04-03T01:40:16.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:45:00+00:00 2024-04-03T01:40:16.704796819Z [2024-04-03T01:40:16.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status success for try_number 1 2024-04-03T01:40:16.709705593Z [2024-04-03T01:40:16.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=-1, run_start_date=2024-04-03 01:40:15.990385+00:00, run_end_date=2024-04-03 01:40:16.311825+00:00, run_duration=0.32144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:13.982687+00:00, queued_by_job_id=1, pid=1313 2024-04-03T01:40:21.829892092Z [2024-04-03T01:40:21.829+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:40:21.829919646Z 2024-04-03T01:40:21.830464649Z [2024-04-03T01:40:21.829+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:40:21.831638790Z [2024-04-03T01:40:21.831+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:40:21.831649198Z 2024-04-03T01:40:21.835586707Z [2024-04-03T01:40:21.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:35:00+00:00', try_number=2, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:40:21.835714583Z [2024-04-03T01:40:21.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'collect_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:40:21.898045186Z [2024-04-03T01:40:21.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.collect_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status queued for try_number 2 2024-04-03T01:40:21.905852800Z [2024-04-03T01:40:21.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bc83385-5c6c-4e1f-ab33-97543ffaf969 2024-04-03T01:40:24.051961656Z [2024-04-03T01:40:24.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218.collect_metrics run_id=scheduled__2024-04-03T01:35:00+00:00 exited with status failed for try_number 2 2024-04-03T01:40:24.060121641Z [2024-04-03T01:40:24.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:35:00+00:00, map_index=0, run_start_date=None, run_end_date=2024-04-03 01:40:11.578566+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:40:21.832414+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:40:24.060731151Z [2024-04-03T01:40:24.060+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:40:24.063295100Z [2024-04-03T01:40:24.062+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:40:24.081040155Z [2024-04-03T01:40:24.080+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=collect_metrics, map_index=0, execution_date=20240403T013500, start_date=, end_date=20240403T014024 2024-04-03T01:40:25.547408422Z [2024-04-03T01:40:25.546+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T01:40:25.547543528Z [2024-04-03T01:40:25.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:35:00+00:00, run_id=scheduled__2024-04-03T01:35:00+00:00, run_start_date=2024-04-03 01:40:00.302815+00:00, run_end_date=2024-04-03 01:40:25.547272+00:00, run_duration=25.244457, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:35:00+00:00, data_interval_end=2024-04-03 01:40:00+00:00, dag_hash=f2b47457475a1364440f1202ec747ebf 2024-04-03T01:40:25.553218507Z [2024-04-03T01:40:25.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:40:00+00:00, run_after=2024-04-03T01:45:00+00:00 2024-04-03T01:41:00.595425698Z [2024-04-03T01:41:00.595+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:41:00.608343991Z [2024-04-03T01:41:00.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:41:00+00:00, run_after=2024-04-03T01:42:00+00:00 2024-04-03T01:41:00.637007305Z [2024-04-03T01:41:00.636+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:41:00.664860500Z [2024-04-03T01:41:00.664+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:41:00+00:00, run_after=2024-04-03T01:42:00+00:00 2024-04-03T01:41:00.747748513Z [2024-04-03T01:41:00.746+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T01:41:00.747767818Z 2024-04-03T01:41:00.747771585Z 2024-04-03T01:41:00.747775008Z 2024-04-03T01:41:00.747778173Z 2024-04-03T01:41:00.747781256Z [2024-04-03T01:41:00.746+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:41:00.747784600Z [2024-04-03T01:41:00.746+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:41:00.747787738Z [2024-04-03T01:41:00.746+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:41:00.747790839Z [2024-04-03T01:41:00.746+0000] {scheduler_job.py:425} INFO - DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:41:00.757856205Z [2024-04-03T01:41:00.748+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:41:00.766465379Z 2024-04-03T01:41:00.766475026Z 2024-04-03T01:41:00.766478169Z 2024-04-03T01:41:00.766481643Z 2024-04-03T01:41:00.766488303Z [2024-04-03T01:41:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:41:00.766498839Z [2024-04-03T01:41:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:41:00.766502082Z [2024-04-03T01:41:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:41:00.766505134Z [2024-04-03T01:41:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:41:00.766508087Z [2024-04-03T01:41:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:41:00.766511416Z [2024-04-03T01:41:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:41:00.766514451Z [2024-04-03T01:41:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:41:00.766517653Z [2024-04-03T01:41:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:41:01.269473579Z [2024-04-03T01:41:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 1 2024-04-03T01:41:01.269502630Z [2024-04-03T01:41:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 1 2024-04-03T01:41:01.269585421Z [2024-04-03T01:41:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 1 2024-04-03T01:41:01.269665941Z [2024-04-03T01:41:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 1 2024-04-03T01:41:01.284617666Z [2024-04-03T01:41:01.284+0000] {scheduler_job.py:635} INFO - Setting external_id for to 473c2137-02b9-48b6-8a91-272133ca91d5 2024-04-03T01:41:01.284717693Z [2024-04-03T01:41:01.284+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e380443-a56f-475b-96be-e42b6f74a7be 2024-04-03T01:41:01.284821086Z [2024-04-03T01:41:01.284+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dc4b370-9fb7-46c0-8388-aee0068c46f3 2024-04-03T01:41:01.284951779Z [2024-04-03T01:41:01.284+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbd33849-57e9-4e13-9ad3-095ecdd584b6 2024-04-03T01:41:03.287675781Z [2024-04-03T01:41:03.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status failed for try_number 1 2024-04-03T01:41:03.297703861Z [2024-04-03T01:41:03.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:41:00.749488+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:41:03.298346157Z [2024-04-03T01:41:03.298+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:41:03.312649539Z [2024-04-03T01:41:03.312+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:41:03.338517621Z [2024-04-03T01:41:03.338+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240403T014000, start_date=, end_date=20240403T014103 2024-04-03T01:41:04.487541594Z [2024-04-03T01:41:04.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status failed for try_number 1 2024-04-03T01:41:04.492523251Z [2024-04-03T01:41:04.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:41:00.749488+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:41:04.492824474Z [2024-04-03T01:41:04.492+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:41:04.495190891Z [2024-04-03T01:41:04.494+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:41:04.506313812Z [2024-04-03T01:41:04.506+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240403T014000, start_date=, end_date=20240403T014104 2024-04-03T01:41:05.560476580Z [2024-04-03T01:41:05.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:41:05.560708567Z [2024-04-03T01:41:05.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:40:00+00:00, run_id=scheduled__2024-04-03T01:40:00+00:00, run_start_date=2024-04-03 01:41:00.678934+00:00, run_end_date=2024-04-03 01:41:05.560360+00:00, run_duration=4.881426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:40:00+00:00, data_interval_end=2024-04-03 01:41:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:41:05.570242493Z [2024-04-03T01:41:05.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:41:00+00:00, run_after=2024-04-03T01:42:00+00:00 2024-04-03T01:41:05.599697949Z [2024-04-03T01:41:05.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:41:05.599993333Z [2024-04-03T01:41:05.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:40:00+00:00, run_id=scheduled__2024-04-03T01:40:00+00:00, run_start_date=2024-04-03 01:41:00.677846+00:00, run_end_date=2024-04-03 01:41:05.599621+00:00, run_duration=4.921775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:40:00+00:00, data_interval_end=2024-04-03 01:41:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:41:05.616418662Z [2024-04-03T01:41:05.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:41:00+00:00, run_after=2024-04-03T01:42:00+00:00 2024-04-03T01:41:05.666063106Z [2024-04-03T01:41:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status success for try_number 1 2024-04-03T01:41:05.666150347Z [2024-04-03T01:41:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status success for try_number 1 2024-04-03T01:41:05.678130670Z [2024-04-03T01:41:05.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=2024-04-03 01:41:03.440208+00:00, run_end_date=2024-04-03 01:41:05.283978+00:00, run_duration=1.84377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:41:00.749488+00:00, queued_by_job_id=1, pid=1408 2024-04-03T01:41:05.678450171Z [2024-04-03T01:41:05.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=2024-04-03 01:41:03.560555+00:00, run_end_date=2024-04-03 01:41:05.001142+00:00, run_duration=1.440587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:41:00.749488+00:00, queued_by_job_id=1, pid=1409 2024-04-03T01:41:13.420806881Z [2024-04-03T01:41:13.420+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:41:13.420838797Z 2024-04-03T01:41:13.421297094Z [2024-04-03T01:41:13.420+0000] {scheduler_job.py:425} INFO - DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:41:13.421899944Z [2024-04-03T01:41:13.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:41:13.421909018Z 2024-04-03T01:41:13.424693811Z [2024-04-03T01:41:13.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:41:13.425218292Z [2024-04-03T01:41:13.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:41:13.471475705Z [2024-04-03T01:41:13.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 2 2024-04-03T01:41:13.475709037Z [2024-04-03T01:41:13.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25ff04d8-1938-423b-9e5f-dcfd9d7a6a1f 2024-04-03T01:41:14.623908158Z [2024-04-03T01:41:14.623+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:41:14.623937095Z 2024-04-03T01:41:14.624314408Z [2024-04-03T01:41:14.624+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 has 0/16 running and queued tasks 2024-04-03T01:41:14.624923570Z [2024-04-03T01:41:14.624+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:41:14.624929617Z 2024-04-03T01:41:14.630327724Z [2024-04-03T01:41:14.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:41:14.630745773Z [2024-04-03T01:41:14.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:41:14.690571405Z [2024-04-03T01:41:14.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 2 2024-04-03T01:41:14.705976182Z [2024-04-03T01:41:14.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 174e48ec-8c85-4e64-b5a8-82ea8dba60af 2024-04-03T01:41:15.907977748Z [2024-04-03T01:41:15.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c141e420-fb9e-461e-aff0-9b8604830218.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status failed for try_number 2 2024-04-03T01:41:15.912506275Z [2024-04-03T01:41:15.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-03 01:41:03.320751+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:41:13.422447+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:41:15.912787993Z [2024-04-03T01:41:15.912+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:41:15.914538652Z [2024-04-03T01:41:15.914+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:41:15.926145616Z [2024-04-03T01:41:15.925+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240403T014000, start_date=, end_date=20240403T014115 2024-04-03T01:41:16.971514111Z [2024-04-03T01:41:16.971+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T01:41:16.971796927Z [2024-04-03T01:41:16.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:40:00+00:00, run_id=scheduled__2024-04-03T01:40:00+00:00, run_start_date=2024-04-03 01:41:00.679869+00:00, run_end_date=2024-04-03 01:41:16.971422+00:00, run_duration=16.291553, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:40:00+00:00, data_interval_end=2024-04-03 01:41:00+00:00, dag_hash=d424bd1c08f3a998735d85eada0d3e47 2024-04-03T01:41:16.980180278Z [2024-04-03T01:41:16.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:41:00+00:00, run_after=2024-04-03T01:42:00+00:00 2024-04-03T01:41:17.009952576Z [2024-04-03T01:41:17.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status failed for try_number 2 2024-04-03T01:41:17.016502890Z [2024-04-03T01:41:17.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-03 01:41:04.497151+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:41:14.625949+00:00, queued_by_job_id=1, pid=None 2024-04-03T01:41:17.017158745Z [2024-04-03T01:41:17.016+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:41:17.019513165Z [2024-04-03T01:41:17.019+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T01:41:17.031360329Z [2024-04-03T01:41:17.031+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240403T014000, start_date=, end_date=20240403T014117 2024-04-03T01:41:17.769920593Z [2024-04-03T01:41:17.762+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T01:41:17.769945262Z [2024-04-03T01:41:17.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218, execution_date=2024-04-03 01:40:00+00:00, run_id=scheduled__2024-04-03T01:40:00+00:00, run_start_date=2024-04-03 01:41:00.676461+00:00, run_end_date=2024-04-03 01:41:17.762519+00:00, run_duration=17.086058, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:40:00+00:00, data_interval_end=2024-04-03 01:41:00+00:00, dag_hash=9a8d607a43d1345c617993cedbd2a975 2024-04-03T01:41:17.771834523Z [2024-04-03T01:41:17.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 to 2024-04-03T01:41:00+00:00, run_after=2024-04-03T01:42:00+00:00 2024-04-03T01:41:34.918654128Z [2024-04-03T01:41:34.917+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T01:42:00.477961095Z [2024-04-03T01:42:00.477+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:42:00.489367609Z [2024-04-03T01:42:00.488+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:42:00.503344360Z [2024-04-03T01:42:00.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:42:00+00:00, run_after=2024-04-03T01:43:00+00:00 2024-04-03T01:42:00.562931953Z [2024-04-03T01:42:00.562+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:42:00.562969552Z 2024-04-03T01:42:00.562978864Z 2024-04-03T01:42:00.562986179Z 2024-04-03T01:42:00.563024186Z [2024-04-03T01:42:00.562+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:42:00.563140782Z [2024-04-03T01:42:00.563+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:42:00.563256402Z [2024-04-03T01:42:00.563+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:42:00.563897968Z [2024-04-03T01:42:00.563+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:42:00.563910676Z 2024-04-03T01:42:00.563914537Z 2024-04-03T01:42:00.563917773Z 2024-04-03T01:42:00.567819269Z [2024-04-03T01:42:00.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:42:00.567952807Z [2024-04-03T01:42:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:42:00.568176116Z [2024-04-03T01:42:00.568+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:42:00.568280323Z [2024-04-03T01:42:00.568+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:42:00.568472348Z [2024-04-03T01:42:00.568+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:42:00.568564308Z [2024-04-03T01:42:00.568+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:42:00.890790105Z [2024-04-03T01:42:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 1 2024-04-03T01:42:00.890969838Z [2024-04-03T01:42:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:41:00+00:00 exited with status queued for try_number 1 2024-04-03T01:42:00.891120777Z [2024-04-03T01:42:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:41:00+00:00 exited with status queued for try_number 1 2024-04-03T01:42:00.899638523Z [2024-04-03T01:42:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 415f2df1-7031-4bdd-bd07-e62f5558b4a9 2024-04-03T01:42:00.899955156Z [2024-04-03T01:42:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02755255-f045-41d5-92bc-b1c280666840 2024-04-03T01:42:00.900101701Z [2024-04-03T01:42:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bb5aabc-d9d4-4940-81ef-6bf17beefd6d 2024-04-03T01:42:02.144431466Z [2024-04-03T01:42:02.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:42:02.145256009Z [2024-04-03T01:42:02.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:40:00+00:00, run_id=scheduled__2024-04-03T01:40:00+00:00, run_start_date=2024-04-03 01:42:00.512486+00:00, run_end_date=2024-04-03 01:42:02.144388+00:00, run_duration=1.631902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:40:00+00:00, data_interval_end=2024-04-03 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:42:02.153164671Z [2024-04-03T01:42:02.152+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:42:00+00:00, run_after=2024-04-03T01:44:00+00:00 2024-04-03T01:42:03.315731461Z [2024-04-03T01:42:03.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status success for try_number 1 2024-04-03T01:42:03.323539514Z [2024-04-03T01:42:03.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=2024-04-03 01:42:01.578902+00:00, run_end_date=2024-04-03 01:42:02.120293+00:00, run_duration=0.541391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:42:00.564858+00:00, queued_by_job_id=1, pid=1485 2024-04-03T01:42:04.848189414Z [2024-04-03T01:42:04.847+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:42:04.848331695Z [2024-04-03T01:42:04.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:41:00+00:00, run_id=scheduled__2024-04-03T01:41:00+00:00, run_start_date=2024-04-03 01:42:00.514591+00:00, run_end_date=2024-04-03 01:42:04.848034+00:00, run_duration=4.333443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:41:00+00:00, data_interval_end=2024-04-03 01:42:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:42:04.857245546Z [2024-04-03T01:42:04.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:42:00+00:00, run_after=2024-04-03T01:43:00+00:00 2024-04-03T01:42:04.903377320Z [2024-04-03T01:42:04.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:41:00+00:00 exited with status success for try_number 1 2024-04-03T01:42:04.913031628Z [2024-04-03T01:42:04.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:41:00+00:00, map_index=-1, run_start_date=2024-04-03 01:42:03.012020+00:00, run_end_date=2024-04-03 01:42:04.450408+00:00, run_duration=1.438388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:42:00.564858+00:00, queued_by_job_id=1, pid=1515 2024-04-03T01:42:05.977367367Z [2024-04-03T01:42:05.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:42:05.977617509Z [2024-04-03T01:42:05.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:41:00+00:00, run_id=scheduled__2024-04-03T01:41:00+00:00, run_start_date=2024-04-03 01:42:00.513654+00:00, run_end_date=2024-04-03 01:42:05.977359+00:00, run_duration=5.463705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:41:00+00:00, data_interval_end=2024-04-03 01:42:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:42:05.987024912Z [2024-04-03T01:42:05.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:42:00+00:00, run_after=2024-04-03T01:43:00+00:00 2024-04-03T01:42:06.022925986Z [2024-04-03T01:42:06.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:41:00+00:00 exited with status success for try_number 1 2024-04-03T01:42:06.029025914Z [2024-04-03T01:42:06.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:41:00+00:00, map_index=-1, run_start_date=2024-04-03 01:42:03.112937+00:00, run_end_date=2024-04-03 01:42:04.924281+00:00, run_duration=1.811344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:42:00.564858+00:00, queued_by_job_id=1, pid=1516 2024-04-03T01:43:00.300828930Z [2024-04-03T01:43:00.300+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:43:00.313814410Z [2024-04-03T01:43:00.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:43:00+00:00, run_after=2024-04-03T01:44:00+00:00 2024-04-03T01:43:00.358644612Z [2024-04-03T01:43:00.358+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:43:00.358686833Z 2024-04-03T01:43:00.358699278Z 2024-04-03T01:43:00.358725649Z [2024-04-03T01:43:00.358+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:43:00.358890152Z [2024-04-03T01:43:00.358+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:43:00.359427238Z [2024-04-03T01:43:00.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:43:00.359448244Z 2024-04-03T01:43:00.359459771Z 2024-04-03T01:43:00.361917083Z [2024-04-03T01:43:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:43:00.362118856Z [2024-04-03T01:43:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:43:00.362326141Z [2024-04-03T01:43:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:43:00.362494043Z [2024-04-03T01:43:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:43:00.623726930Z [2024-04-03T01:43:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:42:00+00:00 exited with status queued for try_number 1 2024-04-03T01:43:00.623932182Z [2024-04-03T01:43:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:42:00+00:00 exited with status queued for try_number 1 2024-04-03T01:43:00.640935789Z [2024-04-03T01:43:00.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47f7c86f-cf86-48aa-b16e-e0e5f3f215dc 2024-04-03T01:43:00.642343542Z [2024-04-03T01:43:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 749267ad-d546-48f5-a6c7-1150b9acc43d 2024-04-03T01:43:04.171301293Z [2024-04-03T01:43:04.170+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:43:04.171736401Z [2024-04-03T01:43:04.171+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:42:00+00:00, run_id=scheduled__2024-04-03T01:42:00+00:00, run_start_date=2024-04-03 01:43:00.325345+00:00, run_end_date=2024-04-03 01:43:04.171313+00:00, run_duration=3.845968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:42:00+00:00, data_interval_end=2024-04-03 01:43:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:43:04.184326697Z [2024-04-03T01:43:04.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:43:00+00:00, run_after=2024-04-03T01:44:00+00:00 2024-04-03T01:43:04.226584063Z [2024-04-03T01:43:04.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:42:00+00:00 exited with status success for try_number 1 2024-04-03T01:43:04.232580920Z [2024-04-03T01:43:04.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:42:00+00:00, map_index=-1, run_start_date=2024-04-03 01:43:02.456449+00:00, run_end_date=2024-04-03 01:43:03.985482+00:00, run_duration=1.529033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:43:00.359930+00:00, queued_by_job_id=1, pid=1570 2024-04-03T01:43:05.413559707Z [2024-04-03T01:43:05.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:43:05.413878533Z [2024-04-03T01:43:05.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:42:00+00:00, run_id=scheduled__2024-04-03T01:42:00+00:00, run_start_date=2024-04-03 01:43:00.323499+00:00, run_end_date=2024-04-03 01:43:05.413446+00:00, run_duration=5.089947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:42:00+00:00, data_interval_end=2024-04-03 01:43:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:43:05.425823380Z [2024-04-03T01:43:05.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:43:00+00:00, run_after=2024-04-03T01:44:00+00:00 2024-04-03T01:43:05.468291385Z [2024-04-03T01:43:05.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:42:00+00:00 exited with status success for try_number 1 2024-04-03T01:43:05.474787823Z [2024-04-03T01:43:05.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:42:00+00:00, map_index=-1, run_start_date=2024-04-03 01:43:02.579258+00:00, run_end_date=2024-04-03 01:43:04.615096+00:00, run_duration=2.035838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:43:00.359930+00:00, queued_by_job_id=1, pid=1571 2024-04-03T01:44:00.064254057Z [2024-04-03T01:44:00.063+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:44:00.072624495Z [2024-04-03T01:44:00.072+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:44:00.087993556Z [2024-04-03T01:44:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:44:00+00:00, run_after=2024-04-03T01:45:00+00:00 2024-04-03T01:44:00.177545500Z [2024-04-03T01:44:00.177+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:44:00.177566937Z 2024-04-03T01:44:00.177575290Z 2024-04-03T01:44:00.177578793Z 2024-04-03T01:44:00.177588623Z [2024-04-03T01:44:00.177+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:44:00.179339173Z [2024-04-03T01:44:00.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:44:00.179349747Z [2024-04-03T01:44:00.177+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:44:00.179353260Z [2024-04-03T01:44:00.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:44:00.179356471Z 2024-04-03T01:44:00.179359119Z 2024-04-03T01:44:00.179362020Z 2024-04-03T01:44:00.183264002Z [2024-04-03T01:44:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:44:00.183281953Z [2024-04-03T01:44:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:44:00.183289133Z [2024-04-03T01:44:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:44:00.183309055Z [2024-04-03T01:44:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:44:00.183313768Z [2024-04-03T01:44:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:44:00.190410655Z [2024-04-03T01:44:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:44:00.481438097Z [2024-04-03T01:44:00.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:42:00+00:00 exited with status queued for try_number 1 2024-04-03T01:44:00.481523606Z [2024-04-03T01:44:00.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:43:00+00:00 exited with status queued for try_number 1 2024-04-03T01:44:00.481806684Z [2024-04-03T01:44:00.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:43:00+00:00 exited with status queued for try_number 1 2024-04-03T01:44:00.491757162Z [2024-04-03T01:44:00.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to d56c32bc-302d-4858-abfb-06819963ca36 2024-04-03T01:44:00.491962678Z [2024-04-03T01:44:00.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e76b62d-968e-4158-898c-d7d08bb98c15 2024-04-03T01:44:00.492154305Z [2024-04-03T01:44:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8337283f-7d7a-49f6-86d5-72250793b225 2024-04-03T01:44:02.747442292Z [2024-04-03T01:44:02.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:44:02.747618690Z [2024-04-03T01:44:02.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:42:00+00:00, run_id=scheduled__2024-04-03T01:42:00+00:00, run_start_date=2024-04-03 01:44:00.106401+00:00, run_end_date=2024-04-03 01:44:02.747319+00:00, run_duration=2.640918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:42:00+00:00, data_interval_end=2024-04-03 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:44:02.755716395Z [2024-04-03T01:44:02.755+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:44:00+00:00, run_after=2024-04-03T01:46:00+00:00 2024-04-03T01:44:02.836770566Z [2024-04-03T01:44:02.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:42:00+00:00 exited with status success for try_number 1 2024-04-03T01:44:02.848364969Z [2024-04-03T01:44:02.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:42:00+00:00, map_index=-1, run_start_date=2024-04-03 01:44:01.230654+00:00, run_end_date=2024-04-03 01:44:01.701939+00:00, run_duration=0.471285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:44:00.179603+00:00, queued_by_job_id=1, pid=1607 2024-04-03T01:44:03.901144241Z [2024-04-03T01:44:03.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:44:03.901302012Z [2024-04-03T01:44:03.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:43:00+00:00, run_id=scheduled__2024-04-03T01:43:00+00:00, run_start_date=2024-04-03 01:44:00.109335+00:00, run_end_date=2024-04-03 01:44:03.901038+00:00, run_duration=3.791703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:43:00+00:00, data_interval_end=2024-04-03 01:44:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:44:03.919839004Z [2024-04-03T01:44:03.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:44:00+00:00, run_after=2024-04-03T01:45:00+00:00 2024-04-03T01:44:03.974430457Z [2024-04-03T01:44:03.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:43:00+00:00 exited with status success for try_number 1 2024-04-03T01:44:03.984741880Z [2024-04-03T01:44:03.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:43:00+00:00, map_index=-1, run_start_date=2024-04-03 01:44:02.498272+00:00, run_end_date=2024-04-03 01:44:03.728241+00:00, run_duration=1.229969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:44:00.179603+00:00, queued_by_job_id=1, pid=1637 2024-04-03T01:44:04.571805544Z [2024-04-03T01:44:04.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:44:04.571852598Z [2024-04-03T01:44:04.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:43:00+00:00, run_id=scheduled__2024-04-03T01:43:00+00:00, run_start_date=2024-04-03 01:44:00.108104+00:00, run_end_date=2024-04-03 01:44:04.570851+00:00, run_duration=4.462747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:43:00+00:00, data_interval_end=2024-04-03 01:44:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:44:04.580552317Z [2024-04-03T01:44:04.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:44:00+00:00, run_after=2024-04-03T01:45:00+00:00 2024-04-03T01:44:04.613856520Z [2024-04-03T01:44:04.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:43:00+00:00 exited with status success for try_number 1 2024-04-03T01:44:04.619386555Z [2024-04-03T01:44:04.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:43:00+00:00, map_index=-1, run_start_date=2024-04-03 01:44:02.630022+00:00, run_end_date=2024-04-03 01:44:04.441145+00:00, run_duration=1.811123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:44:00.179603+00:00, queued_by_job_id=1, pid=1638 2024-04-03T01:45:00.436611231Z [2024-04-03T01:45:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:45:00.465296748Z [2024-04-03T01:45:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:45:00+00:00, run_after=2024-04-03T01:50:00+00:00 2024-04-03T01:45:00.479988783Z [2024-04-03T01:45:00.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:45:00+00:00, run_after=2024-04-03T01:46:00+00:00 2024-04-03T01:45:00.548878558Z [2024-04-03T01:45:00.548+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:45:00.548902284Z 2024-04-03T01:45:00.548906826Z 2024-04-03T01:45:00.548910160Z 2024-04-03T01:45:00.548919497Z [2024-04-03T01:45:00.548+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:45:00.549007367Z [2024-04-03T01:45:00.548+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:45:00.549089373Z [2024-04-03T01:45:00.548+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:45:00.549685689Z [2024-04-03T01:45:00.549+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:45:00.549697348Z 2024-04-03T01:45:00.549700994Z 2024-04-03T01:45:00.549704654Z 2024-04-03T01:45:00.552424678Z [2024-04-03T01:45:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:45:00.552516447Z [2024-04-03T01:45:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:45:00.552687645Z [2024-04-03T01:45:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:45:00.552764251Z [2024-04-03T01:45:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:45:00.552939312Z [2024-04-03T01:45:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:45:00.553075126Z [2024-04-03T01:45:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:45:01.042213801Z [2024-04-03T01:45:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 1 2024-04-03T01:45:01.042469055Z [2024-04-03T01:45:01.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:44:00+00:00 exited with status queued for try_number 1 2024-04-03T01:45:01.042709650Z [2024-04-03T01:45:01.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:44:00+00:00 exited with status queued for try_number 1 2024-04-03T01:45:01.051718603Z [2024-04-03T01:45:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 127b5051-a251-426d-9b18-71103df34b6a 2024-04-03T01:45:01.052611579Z [2024-04-03T01:45:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6927d199-f09e-4bab-956f-a93971c603e2 2024-04-03T01:45:01.052968067Z [2024-04-03T01:45:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bb28ca7-e32c-42ce-8ce8-8ab65a46fdfd 2024-04-03T01:45:04.712664531Z [2024-04-03T01:45:04.712+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:45:04.712690670Z 2024-04-03T01:45:04.712726897Z [2024-04-03T01:45:04.712+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:45:04.713659729Z [2024-04-03T01:45:04.713+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:45:04.713673051Z 2024-04-03T01:45:04.715919969Z [2024-04-03T01:45:04.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T01:45:04.716046675Z [2024-04-03T01:45:04.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:45:04.767540724Z [2024-04-03T01:45:04.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 1 2024-04-03T01:45:04.767608879Z [2024-04-03T01:45:04.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status success for try_number 1 2024-04-03T01:45:04.774414662Z [2024-04-03T01:45:04.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to 788d59ad-7391-4255-9649-6d8b8fae9591 2024-04-03T01:45:04.774522644Z [2024-04-03T01:45:04.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=2024-04-03 01:45:03.866777+00:00, run_end_date=2024-04-03 01:45:04.317371+00:00, run_duration=0.450594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:45:00.550280+00:00, queued_by_job_id=1, pid=1723 2024-04-03T01:45:04.938338516Z [2024-04-03T01:45:04.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:45:04.938796019Z [2024-04-03T01:45:04.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:44:00+00:00, run_id=scheduled__2024-04-03T01:44:00+00:00, run_start_date=2024-04-03 01:45:00.491711+00:00, run_end_date=2024-04-03 01:45:04.938207+00:00, run_duration=4.446496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:44:00+00:00, data_interval_end=2024-04-03 01:45:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:45:04.952065992Z [2024-04-03T01:45:04.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:45:00+00:00, run_after=2024-04-03T01:46:00+00:00 2024-04-03T01:45:05.000248411Z [2024-04-03T01:45:04.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:44:00+00:00 exited with status success for try_number 1 2024-04-03T01:45:05.011620577Z [2024-04-03T01:45:05.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:44:00+00:00, map_index=-1, run_start_date=2024-04-03 01:45:03.343196+00:00, run_end_date=2024-04-03 01:45:04.836492+00:00, run_duration=1.493296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:45:00.550280+00:00, queued_by_job_id=1, pid=1695 2024-04-03T01:45:06.062181335Z [2024-04-03T01:45:06.061+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:45:06.062535969Z [2024-04-03T01:45:06.062+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:44:00+00:00, run_id=scheduled__2024-04-03T01:44:00+00:00, run_start_date=2024-04-03 01:45:00.490721+00:00, run_end_date=2024-04-03 01:45:06.062066+00:00, run_duration=5.571345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:44:00+00:00, data_interval_end=2024-04-03 01:45:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:45:06.071274360Z [2024-04-03T01:45:06.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:45:00+00:00, run_after=2024-04-03T01:46:00+00:00 2024-04-03T01:45:06.108372133Z [2024-04-03T01:45:06.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:44:00+00:00 exited with status success for try_number 1 2024-04-03T01:45:06.125250936Z [2024-04-03T01:45:06.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:44:00+00:00, map_index=-1, run_start_date=2024-04-03 01:45:03.328001+00:00, run_end_date=2024-04-03 01:45:05.127568+00:00, run_duration=1.799567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:45:00.550280+00:00, queued_by_job_id=1, pid=1694 2024-04-03T01:45:07.538183039Z [2024-04-03T01:45:07.537+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:45:07.538213076Z 2024-04-03T01:45:07.538350652Z [2024-04-03T01:45:07.538+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:45:07.539245258Z [2024-04-03T01:45:07.538+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:45:07.539256830Z 2024-04-03T01:45:07.542258841Z [2024-04-03T01:45:07.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:45:07.542408987Z [2024-04-03T01:45:07.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:45:07.596429389Z [2024-04-03T01:45:07.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 1 2024-04-03T01:45:07.596596798Z [2024-04-03T01:45:07.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status success for try_number 1 2024-04-03T01:45:07.606183692Z [2024-04-03T01:45:07.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=2024-04-03 01:45:06.585991+00:00, run_end_date=2024-04-03 01:45:07.013907+00:00, run_duration=0.427916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:45:04.713910+00:00, queued_by_job_id=1, pid=1744 2024-04-03T01:45:07.606329381Z [2024-04-03T01:45:07.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to d754726c-3df9-4db9-9ef7-c535b1d260a9 2024-04-03T01:45:12.692643638Z [2024-04-03T01:45:12.690+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:45:12.692672469Z 2024-04-03T01:45:12.694369810Z [2024-04-03T01:45:12.692+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:45:12.696238097Z [2024-04-03T01:45:12.695+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:45:12.696251597Z 2024-04-03T01:45:12.708525915Z [2024-04-03T01:45:12.708+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:45:12.710108571Z [2024-04-03T01:45:12.708+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:45:12.767595563Z [2024-04-03T01:45:12.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status queued for try_number 1 2024-04-03T01:45:12.767660486Z [2024-04-03T01:45:12.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status success for try_number 1 2024-04-03T01:45:12.792259579Z [2024-04-03T01:45:12.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=0, run_start_date=2024-04-03 01:45:09.490745+00:00, run_end_date=2024-04-03 01:45:11.537335+00:00, run_duration=2.04659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:45:07.539614+00:00, queued_by_job_id=1, pid=1756 2024-04-03T01:45:12.792289649Z [2024-04-03T01:45:12.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44ceb505-6da6-43dc-a044-f28a0150d0ab 2024-04-03T01:45:16.145799833Z [2024-04-03T01:45:16.145+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:45:16.146212134Z [2024-04-03T01:45:16.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:40:00+00:00, run_id=scheduled__2024-04-03T01:40:00+00:00, run_start_date=2024-04-03 01:45:00.489565+00:00, run_end_date=2024-04-03 01:45:16.145715+00:00, run_duration=15.65615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:40:00+00:00, data_interval_end=2024-04-03 01:45:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T01:45:16.154195174Z [2024-04-03T01:45:16.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:45:00+00:00, run_after=2024-04-03T01:50:00+00:00 2024-04-03T01:45:16.186408245Z [2024-04-03T01:45:16.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:40:00+00:00 exited with status success for try_number 1 2024-04-03T01:45:16.191244658Z [2024-04-03T01:45:16.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T01:40:00+00:00, map_index=-1, run_start_date=2024-04-03 01:45:15.005499+00:00, run_end_date=2024-04-03 01:45:15.362233+00:00, run_duration=0.356734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:45:12.701651+00:00, queued_by_job_id=1, pid=1777 2024-04-03T01:46:00.275748798Z [2024-04-03T01:46:00.275+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:46:00.283471451Z [2024-04-03T01:46:00.283+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:46:00.298148805Z [2024-04-03T01:46:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:46:00+00:00, run_after=2024-04-03T01:47:00+00:00 2024-04-03T01:46:00.424000316Z [2024-04-03T01:46:00.423+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:46:00.424027513Z 2024-04-03T01:46:00.424031875Z 2024-04-03T01:46:00.424035123Z 2024-04-03T01:46:00.424332760Z [2024-04-03T01:46:00.424+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:46:00.424557754Z [2024-04-03T01:46:00.424+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:46:00.424736593Z [2024-04-03T01:46:00.424+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:46:00.425430453Z [2024-04-03T01:46:00.425+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:46:00.425441726Z 2024-04-03T01:46:00.425462366Z 2024-04-03T01:46:00.425478746Z 2024-04-03T01:46:00.436406177Z [2024-04-03T01:46:00.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:46:00.436654969Z [2024-04-03T01:46:00.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:46:00.436898374Z [2024-04-03T01:46:00.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:46:00.437091136Z [2024-04-03T01:46:00.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:46:00.437411391Z [2024-04-03T01:46:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:46:00.437631555Z [2024-04-03T01:46:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:46:00.975296763Z [2024-04-03T01:46:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:44:00+00:00 exited with status queued for try_number 1 2024-04-03T01:46:00.975457606Z [2024-04-03T01:46:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status queued for try_number 1 2024-04-03T01:46:00.975640330Z [2024-04-03T01:46:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status queued for try_number 1 2024-04-03T01:46:00.993773435Z [2024-04-03T01:46:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3862edf-c7a7-43ce-87e5-6cb76f791c74 2024-04-03T01:46:00.994113826Z [2024-04-03T01:46:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c12ee44-8466-4a28-a13c-92384cfd3b0b 2024-04-03T01:46:00.994426956Z [2024-04-03T01:46:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23aeab7c-64b9-42a3-acd3-c5e0e9d949ee 2024-04-03T01:46:03.451785464Z [2024-04-03T01:46:03.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:46:03.452263348Z [2024-04-03T01:46:03.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:44:00+00:00, run_id=scheduled__2024-04-03T01:44:00+00:00, run_start_date=2024-04-03 01:46:00.309216+00:00, run_end_date=2024-04-03 01:46:03.451700+00:00, run_duration=3.142484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:44:00+00:00, data_interval_end=2024-04-03 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:46:03.461022326Z [2024-04-03T01:46:03.460+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:46:00+00:00, run_after=2024-04-03T01:48:00+00:00 2024-04-03T01:46:03.544725551Z [2024-04-03T01:46:03.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:44:00+00:00 exited with status success for try_number 1 2024-04-03T01:46:03.555189656Z [2024-04-03T01:46:03.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:44:00+00:00, map_index=-1, run_start_date=2024-04-03 01:46:01.905374+00:00, run_end_date=2024-04-03 01:46:02.515555+00:00, run_duration=0.610181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:46:00.430435+00:00, queued_by_job_id=1, pid=1794 2024-04-03T01:46:05.365654518Z [2024-04-03T01:46:05.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:46:05.366401311Z [2024-04-03T01:46:05.366+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:45:00+00:00, run_id=scheduled__2024-04-03T01:45:00+00:00, run_start_date=2024-04-03 01:46:00.310432+00:00, run_end_date=2024-04-03 01:46:05.365877+00:00, run_duration=5.055445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:45:00+00:00, data_interval_end=2024-04-03 01:46:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:46:05.397076037Z [2024-04-03T01:46:05.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:46:00+00:00, run_after=2024-04-03T01:47:00+00:00 2024-04-03T01:46:05.408964641Z [2024-04-03T01:46:05.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:46:05.409395096Z [2024-04-03T01:46:05.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:45:00+00:00, run_id=scheduled__2024-04-03T01:45:00+00:00, run_start_date=2024-04-03 01:46:00.311479+00:00, run_end_date=2024-04-03 01:46:05.408863+00:00, run_duration=5.097384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:45:00+00:00, data_interval_end=2024-04-03 01:46:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:46:05.421909427Z [2024-04-03T01:46:05.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:46:00+00:00, run_after=2024-04-03T01:47:00+00:00 2024-04-03T01:46:05.462488259Z [2024-04-03T01:46:05.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status success for try_number 1 2024-04-03T01:46:05.462696655Z [2024-04-03T01:46:05.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status success for try_number 1 2024-04-03T01:46:05.470820724Z [2024-04-03T01:46:05.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:45:00+00:00, map_index=-1, run_start_date=2024-04-03 01:46:03.392156+00:00, run_end_date=2024-04-03 01:46:05.025667+00:00, run_duration=1.633511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:46:00.430435+00:00, queued_by_job_id=1, pid=1824 2024-04-03T01:46:05.471254730Z [2024-04-03T01:46:05.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:45:00+00:00, map_index=-1, run_start_date=2024-04-03 01:46:03.427841+00:00, run_end_date=2024-04-03 01:46:05.095305+00:00, run_duration=1.667464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:46:00.430435+00:00, queued_by_job_id=1, pid=1825 2024-04-03T01:46:34.962837386Z [2024-04-03T01:46:34.962+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T01:47:00.156108413Z [2024-04-03T01:47:00.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:47:00+00:00, run_after=2024-04-03T01:48:00+00:00 2024-04-03T01:47:00.161186031Z [2024-04-03T01:47:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:47:00.231771868Z [2024-04-03T01:47:00.231+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:47:00.231803286Z 2024-04-03T01:47:00.231809809Z 2024-04-03T01:47:00.232055994Z [2024-04-03T01:47:00.231+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:47:00.232258868Z [2024-04-03T01:47:00.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:47:00.232953636Z [2024-04-03T01:47:00.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:47:00.232964872Z 2024-04-03T01:47:00.232968485Z 2024-04-03T01:47:00.239356424Z [2024-04-03T01:47:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:47:00.239635783Z [2024-04-03T01:47:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:47:00.239960983Z [2024-04-03T01:47:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:47:00.240122572Z [2024-04-03T01:47:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:47:00.490207836Z [2024-04-03T01:47:00.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:46:00+00:00 exited with status queued for try_number 1 2024-04-03T01:47:00.490532112Z [2024-04-03T01:47:00.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:46:00+00:00 exited with status queued for try_number 1 2024-04-03T01:47:00.507563635Z [2024-04-03T01:47:00.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to fedd5fd1-c87f-4e62-8e2f-5cf2baffc67b 2024-04-03T01:47:00.507797445Z [2024-04-03T01:47:00.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to a670e79b-22b4-422b-8035-15f5d0eb3c3e 2024-04-03T01:47:05.446920087Z [2024-04-03T01:47:05.446+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:47:05.447477307Z [2024-04-03T01:47:05.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:46:00+00:00, run_id=scheduled__2024-04-03T01:46:00+00:00, run_start_date=2024-04-03 01:47:00.179929+00:00, run_end_date=2024-04-03 01:47:05.446802+00:00, run_duration=5.266873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:46:00+00:00, data_interval_end=2024-04-03 01:47:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:47:05.457157357Z [2024-04-03T01:47:05.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:47:00+00:00, run_after=2024-04-03T01:48:00+00:00 2024-04-03T01:47:05.502996416Z [2024-04-03T01:47:05.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:46:00+00:00 exited with status success for try_number 1 2024-04-03T01:47:05.508533776Z [2024-04-03T01:47:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:46:00+00:00, map_index=-1, run_start_date=2024-04-03 01:47:02.536763+00:00, run_end_date=2024-04-03 01:47:04.545114+00:00, run_duration=2.008351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:47:00.233490+00:00, queued_by_job_id=1, pid=1869 2024-04-03T01:47:06.904592713Z [2024-04-03T01:47:06.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:47:06.904853628Z [2024-04-03T01:47:06.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:46:00+00:00, run_id=scheduled__2024-04-03T01:46:00+00:00, run_start_date=2024-04-03 01:47:00.181426+00:00, run_end_date=2024-04-03 01:47:06.904475+00:00, run_duration=6.723049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:46:00+00:00, data_interval_end=2024-04-03 01:47:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:47:06.913290124Z [2024-04-03T01:47:06.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:47:00+00:00, run_after=2024-04-03T01:48:00+00:00 2024-04-03T01:47:06.944863603Z [2024-04-03T01:47:06.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:46:00+00:00 exited with status success for try_number 1 2024-04-03T01:47:06.949908960Z [2024-04-03T01:47:06.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:46:00+00:00, map_index=-1, run_start_date=2024-04-03 01:47:02.808652+00:00, run_end_date=2024-04-03 01:47:06.297994+00:00, run_duration=3.489342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:47:00.233490+00:00, queued_by_job_id=1, pid=1879 2024-04-03T01:48:01.094051554Z [2024-04-03T01:48:01.093+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:48:01.104027637Z [2024-04-03T01:48:01.103+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:48:01.117560678Z [2024-04-03T01:48:01.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:48:00+00:00, run_after=2024-04-03T01:49:00+00:00 2024-04-03T01:48:01.201084115Z [2024-04-03T01:48:01.200+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:48:01.201103885Z 2024-04-03T01:48:01.201107779Z 2024-04-03T01:48:01.201111635Z 2024-04-03T01:48:01.201315171Z [2024-04-03T01:48:01.201+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:48:01.201513052Z [2024-04-03T01:48:01.201+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:48:01.201669240Z [2024-04-03T01:48:01.201+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:48:01.202355756Z [2024-04-03T01:48:01.202+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:48:01.202370134Z 2024-04-03T01:48:01.202373518Z 2024-04-03T01:48:01.202381024Z 2024-04-03T01:48:01.205772594Z [2024-04-03T01:48:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:48:01.205978079Z [2024-04-03T01:48:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:48:01.206371111Z [2024-04-03T01:48:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:48:01.206549339Z [2024-04-03T01:48:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:48:01.206842314Z [2024-04-03T01:48:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:48:01.206980223Z [2024-04-03T01:48:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:48:01.522023393Z [2024-04-03T01:48:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:46:00+00:00 exited with status queued for try_number 1 2024-04-03T01:48:01.522053941Z [2024-04-03T01:48:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:47:00+00:00 exited with status queued for try_number 1 2024-04-03T01:48:01.522110679Z [2024-04-03T01:48:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:47:00+00:00 exited with status queued for try_number 1 2024-04-03T01:48:01.536219273Z [2024-04-03T01:48:01.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac172c49-491f-4fc0-b1b9-330a89eb7f4a 2024-04-03T01:48:01.536322352Z [2024-04-03T01:48:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4e2db5f-2ed0-42bb-a640-da5fe0060545 2024-04-03T01:48:01.536435737Z [2024-04-03T01:48:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0686e248-7c91-46ce-985b-1d41e8f503d5 2024-04-03T01:48:02.684981123Z [2024-04-03T01:48:02.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:48:02.685197396Z [2024-04-03T01:48:02.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:46:00+00:00, run_id=scheduled__2024-04-03T01:46:00+00:00, run_start_date=2024-04-03 01:48:01.132156+00:00, run_end_date=2024-04-03 01:48:02.684873+00:00, run_duration=1.552717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:46:00+00:00, data_interval_end=2024-04-03 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:48:02.693928564Z [2024-04-03T01:48:02.693+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:48:00+00:00, run_after=2024-04-03T01:50:00+00:00 2024-04-03T01:48:02.743598567Z [2024-04-03T01:48:02.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:46:00+00:00 exited with status success for try_number 1 2024-04-03T01:48:02.752821576Z [2024-04-03T01:48:02.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:46:00+00:00, map_index=-1, run_start_date=2024-04-03 01:48:01.912981+00:00, run_end_date=2024-04-03 01:48:02.308296+00:00, run_duration=0.395315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:48:01.203261+00:00, queued_by_job_id=1, pid=1914 2024-04-03T01:48:05.125000847Z [2024-04-03T01:48:05.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:48:05.125703173Z [2024-04-03T01:48:05.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:47:00+00:00, run_id=scheduled__2024-04-03T01:47:00+00:00, run_start_date=2024-04-03 01:48:01.135196+00:00, run_end_date=2024-04-03 01:48:05.125141+00:00, run_duration=3.989945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:47:00+00:00, data_interval_end=2024-04-03 01:48:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:48:05.134404749Z [2024-04-03T01:48:05.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:48:00+00:00, run_after=2024-04-03T01:49:00+00:00 2024-04-03T01:48:06.147197987Z [2024-04-03T01:48:06.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:48:06.147384442Z [2024-04-03T01:48:06.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:47:00+00:00, run_id=scheduled__2024-04-03T01:47:00+00:00, run_start_date=2024-04-03 01:48:01.133341+00:00, run_end_date=2024-04-03 01:48:06.147052+00:00, run_duration=5.013711, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:47:00+00:00, data_interval_end=2024-04-03 01:48:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:48:06.158413168Z [2024-04-03T01:48:06.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:48:00+00:00, run_after=2024-04-03T01:49:00+00:00 2024-04-03T01:48:06.184271756Z [2024-04-03T01:48:06.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:47:00+00:00 exited with status success for try_number 1 2024-04-03T01:48:06.184306911Z [2024-04-03T01:48:06.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:47:00+00:00 exited with status success for try_number 1 2024-04-03T01:48:06.189982493Z [2024-04-03T01:48:06.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:47:00+00:00, map_index=-1, run_start_date=2024-04-03 01:48:03.133326+00:00, run_end_date=2024-04-03 01:48:05.046008+00:00, run_duration=1.912682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:48:01.203261+00:00, queued_by_job_id=1, pid=1944 2024-04-03T01:48:06.190108611Z [2024-04-03T01:48:06.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:47:00+00:00, map_index=-1, run_start_date=2024-04-03 01:48:03.265365+00:00, run_end_date=2024-04-03 01:48:05.494833+00:00, run_duration=2.229468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:48:01.203261+00:00, queued_by_job_id=1, pid=1945 2024-04-03T01:49:00.735496792Z [2024-04-03T01:49:00.734+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:49:00.769167614Z [2024-04-03T01:49:00.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:49:00+00:00, run_after=2024-04-03T01:50:00+00:00 2024-04-03T01:49:00.837188373Z [2024-04-03T01:49:00.836+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:49:00.837203030Z 2024-04-03T01:49:00.837206579Z 2024-04-03T01:49:00.837383743Z [2024-04-03T01:49:00.837+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:49:00.837518212Z [2024-04-03T01:49:00.837+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:49:00.838112561Z [2024-04-03T01:49:00.837+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:49:00.838124059Z 2024-04-03T01:49:00.838137546Z 2024-04-03T01:49:00.840641929Z [2024-04-03T01:49:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:49:00.840797490Z [2024-04-03T01:49:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:49:00.841068553Z [2024-04-03T01:49:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:49:00.841220908Z [2024-04-03T01:49:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:49:01.092241799Z [2024-04-03T01:49:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:48:00+00:00 exited with status queued for try_number 1 2024-04-03T01:49:01.092505742Z [2024-04-03T01:49:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:48:00+00:00 exited with status queued for try_number 1 2024-04-03T01:49:01.102534708Z [2024-04-03T01:49:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5f978b2-a3e7-49cb-bb2f-8923d275d063 2024-04-03T01:49:01.103044871Z [2024-04-03T01:49:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 445e133d-df26-4e33-9d48-5479b504f152 2024-04-03T01:49:05.872346411Z [2024-04-03T01:49:05.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:49:05.872616651Z [2024-04-03T01:49:05.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:48:00+00:00, run_id=scheduled__2024-04-03T01:48:00+00:00, run_start_date=2024-04-03 01:49:00.784878+00:00, run_end_date=2024-04-03 01:49:05.872091+00:00, run_duration=5.087213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:48:00+00:00, data_interval_end=2024-04-03 01:49:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:49:05.888565904Z [2024-04-03T01:49:05.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:49:00+00:00, run_after=2024-04-03T01:50:00+00:00 2024-04-03T01:49:05.899632146Z [2024-04-03T01:49:05.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:49:05.899948345Z [2024-04-03T01:49:05.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:48:00+00:00, run_id=scheduled__2024-04-03T01:48:00+00:00, run_start_date=2024-04-03 01:49:00.786120+00:00, run_end_date=2024-04-03 01:49:05.899460+00:00, run_duration=5.11334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:48:00+00:00, data_interval_end=2024-04-03 01:49:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:49:05.916858830Z [2024-04-03T01:49:05.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:49:00+00:00, run_after=2024-04-03T01:50:00+00:00 2024-04-03T01:49:05.956064715Z [2024-04-03T01:49:05.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:48:00+00:00 exited with status success for try_number 1 2024-04-03T01:49:05.956125869Z [2024-04-03T01:49:05.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:48:00+00:00 exited with status success for try_number 1 2024-04-03T01:49:05.964512008Z [2024-04-03T01:49:05.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:48:00+00:00, map_index=-1, run_start_date=2024-04-03 01:49:02.892051+00:00, run_end_date=2024-04-03 01:49:04.979859+00:00, run_duration=2.087808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:49:00.838636+00:00, queued_by_job_id=1, pid=1999 2024-04-03T01:49:05.964778363Z [2024-04-03T01:49:05.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:48:00+00:00, map_index=-1, run_start_date=2024-04-03 01:49:02.893817+00:00, run_end_date=2024-04-03 01:49:05.014126+00:00, run_duration=2.120309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:49:00.838636+00:00, queued_by_job_id=1, pid=2000 2024-04-03T01:50:00.587864483Z [2024-04-03T01:50:00.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:50:00+00:00, run_after=2024-04-03T01:55:00+00:00 2024-04-03T01:50:00.605347120Z [2024-04-03T01:50:00.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:50:00+00:00, run_after=2024-04-03T01:51:00+00:00 2024-04-03T01:50:00.619336413Z [2024-04-03T01:50:00.619+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:50:00.630773653Z [2024-04-03T01:50:00.630+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:50:00.709269184Z [2024-04-03T01:50:00.708+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T01:50:00.709306995Z 2024-04-03T01:50:00.709311751Z 2024-04-03T01:50:00.709315552Z 2024-04-03T01:50:00.709318623Z 2024-04-03T01:50:00.709546991Z [2024-04-03T01:50:00.709+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:50:00.709729287Z [2024-04-03T01:50:00.709+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:50:00.709919908Z [2024-04-03T01:50:00.709+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:50:00.710078262Z [2024-04-03T01:50:00.709+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:50:00.710933654Z [2024-04-03T01:50:00.710+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:50:00.710947219Z 2024-04-03T01:50:00.710950965Z 2024-04-03T01:50:00.710954379Z 2024-04-03T01:50:00.710957845Z 2024-04-03T01:50:00.714297411Z [2024-04-03T01:50:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:50:00.714535259Z [2024-04-03T01:50:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:50:00.714949121Z [2024-04-03T01:50:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:50:00.715146661Z [2024-04-03T01:50:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:50:00.715474863Z [2024-04-03T01:50:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:50:00.715651258Z [2024-04-03T01:50:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:50:00.716038774Z [2024-04-03T01:50:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:50:00.716213771Z [2024-04-03T01:50:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:50:01.114274317Z [2024-04-03T01:50:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status queued for try_number 1 2024-04-03T01:50:01.115393546Z [2024-04-03T01:50:01.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:48:00+00:00 exited with status queued for try_number 1 2024-04-03T01:50:01.115524681Z [2024-04-03T01:50:01.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:49:00+00:00 exited with status queued for try_number 1 2024-04-03T01:50:01.115701716Z [2024-04-03T01:50:01.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:49:00+00:00 exited with status queued for try_number 1 2024-04-03T01:50:01.128659283Z [2024-04-03T01:50:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61b37884-e947-4a8e-81ad-feb07a031672 2024-04-03T01:50:01.129565042Z [2024-04-03T01:50:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7dfa4d8-723b-4ea8-8b06-826872dc63c2 2024-04-03T01:50:01.129891077Z [2024-04-03T01:50:01.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8edcb558-e4f3-4ab8-aa47-96bef2d3f616 2024-04-03T01:50:01.130142673Z [2024-04-03T01:50:01.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b9da594-c82c-4dd8-ac4c-3b0432278110 2024-04-03T01:50:02.308707397Z [2024-04-03T01:50:02.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:50:02.309041546Z [2024-04-03T01:50:02.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:48:00+00:00, run_id=scheduled__2024-04-03T01:48:00+00:00, run_start_date=2024-04-03 01:50:00.646216+00:00, run_end_date=2024-04-03 01:50:02.308624+00:00, run_duration=1.662408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:48:00+00:00, data_interval_end=2024-04-03 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:50:02.326842969Z [2024-04-03T01:50:02.326+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:50:00+00:00, run_after=2024-04-03T01:52:00+00:00 2024-04-03T01:50:03.527087184Z [2024-04-03T01:50:03.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:48:00+00:00 exited with status success for try_number 1 2024-04-03T01:50:03.538439347Z [2024-04-03T01:50:03.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:48:00+00:00, map_index=-1, run_start_date=2024-04-03 01:50:01.844933+00:00, run_end_date=2024-04-03 01:50:02.210121+00:00, run_duration=0.365188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:50:00.711806+00:00, queued_by_job_id=1, pid=2035 2024-04-03T01:50:04.607978704Z [2024-04-03T01:50:04.607+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:50:04.608008359Z 2024-04-03T01:50:04.608271479Z [2024-04-03T01:50:04.608+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:50:04.608946203Z [2024-04-03T01:50:04.608+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:50:04.608958453Z 2024-04-03T01:50:04.611317908Z [2024-04-03T01:50:04.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T01:50:04.611631356Z [2024-04-03T01:50:04.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:50:04.661899168Z [2024-04-03T01:50:04.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status queued for try_number 1 2024-04-03T01:50:04.662438873Z [2024-04-03T01:50:04.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status success for try_number 1 2024-04-03T01:50:04.669068151Z [2024-04-03T01:50:04.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c037603-2e0f-41fe-bf89-531f197cf8ae 2024-04-03T01:50:04.669525897Z [2024-04-03T01:50:04.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:45:00+00:00, map_index=-1, run_start_date=2024-04-03 01:50:03.785207+00:00, run_end_date=2024-04-03 01:50:04.291480+00:00, run_duration=0.506273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:50:00.711806+00:00, queued_by_job_id=1, pid=2086 2024-04-03T01:50:05.815843433Z [2024-04-03T01:50:05.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:50:05.816527773Z [2024-04-03T01:50:05.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:49:00+00:00, run_id=scheduled__2024-04-03T01:49:00+00:00, run_start_date=2024-04-03 01:50:00.647331+00:00, run_end_date=2024-04-03 01:50:05.816050+00:00, run_duration=5.168719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:49:00+00:00, data_interval_end=2024-04-03 01:50:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:50:05.837189705Z [2024-04-03T01:50:05.836+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:50:00+00:00, run_after=2024-04-03T01:51:00+00:00 2024-04-03T01:50:05.848782750Z [2024-04-03T01:50:05.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:50:05.849440829Z [2024-04-03T01:50:05.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:49:00+00:00, run_id=scheduled__2024-04-03T01:49:00+00:00, run_start_date=2024-04-03 01:50:00.648364+00:00, run_end_date=2024-04-03 01:50:05.848889+00:00, run_duration=5.200525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:49:00+00:00, data_interval_end=2024-04-03 01:50:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:50:05.870680883Z [2024-04-03T01:50:05.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:50:00+00:00, run_after=2024-04-03T01:51:00+00:00 2024-04-03T01:50:05.931916757Z [2024-04-03T01:50:05.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:49:00+00:00 exited with status success for try_number 1 2024-04-03T01:50:05.932243261Z [2024-04-03T01:50:05.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:49:00+00:00 exited with status success for try_number 1 2024-04-03T01:50:05.939896568Z [2024-04-03T01:50:05.939+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:49:00+00:00, map_index=-1, run_start_date=2024-04-03 01:50:03.073267+00:00, run_end_date=2024-04-03 01:50:04.799060+00:00, run_duration=1.725793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:50:00.711806+00:00, queued_by_job_id=1, pid=2057 2024-04-03T01:50:05.940288396Z [2024-04-03T01:50:05.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:49:00+00:00, map_index=-1, run_start_date=2024-04-03 01:50:03.644645+00:00, run_end_date=2024-04-03 01:50:05.077314+00:00, run_duration=1.432669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:50:00.711806+00:00, queued_by_job_id=1, pid=2085 2024-04-03T01:50:06.872502717Z [2024-04-03T01:50:06.872+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:50:06.872563667Z 2024-04-03T01:50:06.872610647Z [2024-04-03T01:50:06.872+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:50:06.873271307Z [2024-04-03T01:50:06.873+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:50:06.873283249Z 2024-04-03T01:50:06.875374464Z [2024-04-03T01:50:06.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:50:06.875543599Z [2024-04-03T01:50:06.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:50:06.919517941Z [2024-04-03T01:50:06.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status queued for try_number 1 2024-04-03T01:50:06.919556626Z [2024-04-03T01:50:06.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status success for try_number 1 2024-04-03T01:50:06.925123229Z [2024-04-03T01:50:06.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab2f12dd-3f39-49c2-8eda-267293d7bbaf 2024-04-03T01:50:06.925247244Z [2024-04-03T01:50:06.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T01:45:00+00:00, map_index=-1, run_start_date=2024-04-03 01:50:06.263785+00:00, run_end_date=2024-04-03 01:50:06.544798+00:00, run_duration=0.281013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:50:04.609383+00:00, queued_by_job_id=1, pid=2116 2024-04-03T01:50:09.148872885Z [2024-04-03T01:50:09.148+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:50:09.148903848Z 2024-04-03T01:50:09.149283761Z [2024-04-03T01:50:09.149+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:50:09.150134188Z [2024-04-03T01:50:09.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:50:09.150148378Z 2024-04-03T01:50:09.152992649Z [2024-04-03T01:50:09.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:50:09.153315430Z [2024-04-03T01:50:09.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:50:09.201464838Z [2024-04-03T01:50:09.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status queued for try_number 1 2024-04-03T01:50:09.201688133Z [2024-04-03T01:50:09.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status success for try_number 1 2024-04-03T01:50:09.207823929Z [2024-04-03T01:50:09.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:45:00+00:00, map_index=0, run_start_date=2024-04-03 01:50:08.466913+00:00, run_end_date=2024-04-03 01:50:08.800914+00:00, run_duration=0.334001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:50:06.873586+00:00, queued_by_job_id=1, pid=2128 2024-04-03T01:50:09.208103712Z [2024-04-03T01:50:09.207+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab600d0a-8e81-4f7b-87a9-28dcdaff65f2 2024-04-03T01:50:11.882463063Z [2024-04-03T01:50:11.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:50:11.882517396Z [2024-04-03T01:50:11.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:45:00+00:00, run_id=scheduled__2024-04-03T01:45:00+00:00, run_start_date=2024-04-03 01:50:00.644906+00:00, run_end_date=2024-04-03 01:50:11.871758+00:00, run_duration=11.226852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:45:00+00:00, data_interval_end=2024-04-03 01:50:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T01:50:11.890781281Z [2024-04-03T01:50:11.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:50:00+00:00, run_after=2024-04-03T01:55:00+00:00 2024-04-03T01:50:11.922288376Z [2024-04-03T01:50:11.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:45:00+00:00 exited with status success for try_number 1 2024-04-03T01:50:11.932806899Z [2024-04-03T01:50:11.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T01:45:00+00:00, map_index=-1, run_start_date=2024-04-03 01:50:10.940984+00:00, run_end_date=2024-04-03 01:50:11.311786+00:00, run_duration=0.370802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:50:09.150814+00:00, queued_by_job_id=1, pid=2140 2024-04-03T01:51:00.346066915Z [2024-04-03T01:51:00.344+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:51:00.366879675Z [2024-04-03T01:51:00.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:51:00+00:00, run_after=2024-04-03T01:52:00+00:00 2024-04-03T01:51:00.434035205Z [2024-04-03T01:51:00.433+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:51:00.434063144Z 2024-04-03T01:51:00.434067442Z 2024-04-03T01:51:00.434413018Z [2024-04-03T01:51:00.434+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:51:00.434702512Z [2024-04-03T01:51:00.434+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:51:00.435562289Z [2024-04-03T01:51:00.435+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:51:00.435570924Z 2024-04-03T01:51:00.435574202Z 2024-04-03T01:51:00.438577023Z [2024-04-03T01:51:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:51:00.438764425Z [2024-04-03T01:51:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:51:00.439011514Z [2024-04-03T01:51:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:51:00.439172699Z [2024-04-03T01:51:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:51:00.592599960Z [2024-04-03T01:51:00.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status queued for try_number 1 2024-04-03T01:51:00.592745710Z [2024-04-03T01:51:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status queued for try_number 1 2024-04-03T01:51:00.601973984Z [2024-04-03T01:51:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ab43cd1-e732-4a71-b6bd-1da90055240e 2024-04-03T01:51:00.602163540Z [2024-04-03T01:51:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to be2f079b-e45c-4aae-aee9-e649f388e632 2024-04-03T01:51:04.178225417Z [2024-04-03T01:51:04.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:51:04.179146204Z [2024-04-03T01:51:04.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:50:00+00:00, run_id=scheduled__2024-04-03T01:50:00+00:00, run_start_date=2024-04-03 01:51:00.380561+00:00, run_end_date=2024-04-03 01:51:04.178674+00:00, run_duration=3.798113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:50:00+00:00, data_interval_end=2024-04-03 01:51:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:51:04.188876483Z [2024-04-03T01:51:04.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:51:00+00:00, run_after=2024-04-03T01:52:00+00:00 2024-04-03T01:51:04.195305992Z [2024-04-03T01:51:04.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:51:04.195771433Z [2024-04-03T01:51:04.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:50:00+00:00, run_id=scheduled__2024-04-03T01:50:00+00:00, run_start_date=2024-04-03 01:51:00.381888+00:00, run_end_date=2024-04-03 01:51:04.195418+00:00, run_duration=3.81353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:50:00+00:00, data_interval_end=2024-04-03 01:51:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:51:04.205806943Z [2024-04-03T01:51:04.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:51:00+00:00, run_after=2024-04-03T01:52:00+00:00 2024-04-03T01:51:04.233937389Z [2024-04-03T01:51:04.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status success for try_number 1 2024-04-03T01:51:04.238934498Z [2024-04-03T01:51:04.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:50:00+00:00, map_index=-1, run_start_date=2024-04-03 01:51:02.481862+00:00, run_end_date=2024-04-03 01:51:03.768360+00:00, run_duration=1.286498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:51:00.436281+00:00, queued_by_job_id=1, pid=2176 2024-04-03T01:51:05.309061640Z [2024-04-03T01:51:05.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status success for try_number 1 2024-04-03T01:51:05.316271046Z [2024-04-03T01:51:05.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:50:00+00:00, map_index=-1, run_start_date=2024-04-03 01:51:02.451194+00:00, run_end_date=2024-04-03 01:51:04.124013+00:00, run_duration=1.672819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:51:00.436281+00:00, queued_by_job_id=1, pid=2175 2024-04-03T01:51:35.004437478Z [2024-04-03T01:51:35.003+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T01:52:00.848474185Z [2024-04-03T01:52:00.848+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:52:00.855813300Z [2024-04-03T01:52:00.855+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:52:00.873746966Z [2024-04-03T01:52:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:52:00+00:00, run_after=2024-04-03T01:53:00+00:00 2024-04-03T01:52:00.935173351Z [2024-04-03T01:52:00.934+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:52:00.935200444Z 2024-04-03T01:52:00.935205031Z 2024-04-03T01:52:00.935208762Z 2024-04-03T01:52:00.935352111Z [2024-04-03T01:52:00.935+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:52:00.935555896Z [2024-04-03T01:52:00.935+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:52:00.935804646Z [2024-04-03T01:52:00.935+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:52:00.936412553Z [2024-04-03T01:52:00.936+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:52:00.936428208Z 2024-04-03T01:52:00.936432514Z 2024-04-03T01:52:00.936435670Z 2024-04-03T01:52:00.939397176Z [2024-04-03T01:52:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:52:00.939648929Z [2024-04-03T01:52:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:52:00.939954249Z [2024-04-03T01:52:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:52:00.940189071Z [2024-04-03T01:52:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:52:00.940483996Z [2024-04-03T01:52:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:52:00.940661277Z [2024-04-03T01:52:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:52:01.331886566Z [2024-04-03T01:52:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status queued for try_number 1 2024-04-03T01:52:01.332253451Z [2024-04-03T01:52:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:51:00+00:00 exited with status queued for try_number 1 2024-04-03T01:52:01.332415570Z [2024-04-03T01:52:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:51:00+00:00 exited with status queued for try_number 1 2024-04-03T01:52:01.346585398Z [2024-04-03T01:52:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ebacecc-8e9d-429e-8d6a-15c54b5b35c3 2024-04-03T01:52:01.347327181Z [2024-04-03T01:52:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to eeb8a509-c79e-4260-ac4e-e8c2c344ab6a 2024-04-03T01:52:01.347811800Z [2024-04-03T01:52:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0e5ba07-626b-4ba2-affa-7d997e981c13 2024-04-03T01:52:02.733021770Z [2024-04-03T01:52:02.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:52:02.733175197Z [2024-04-03T01:52:02.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:50:00+00:00, run_id=scheduled__2024-04-03T01:50:00+00:00, run_start_date=2024-04-03 01:52:00.889112+00:00, run_end_date=2024-04-03 01:52:02.732849+00:00, run_duration=1.843737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:50:00+00:00, data_interval_end=2024-04-03 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:52:02.741005953Z [2024-04-03T01:52:02.740+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:52:00+00:00, run_after=2024-04-03T01:54:00+00:00 2024-04-03T01:52:02.831337513Z [2024-04-03T01:52:02.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status success for try_number 1 2024-04-03T01:52:02.842274219Z [2024-04-03T01:52:02.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:50:00+00:00, map_index=-1, run_start_date=2024-04-03 01:52:02.113923+00:00, run_end_date=2024-04-03 01:52:02.580530+00:00, run_duration=0.466607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:52:00.937121+00:00, queued_by_job_id=1, pid=2211 2024-04-03T01:52:06.113407308Z [2024-04-03T01:52:06.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:52:06.113563260Z [2024-04-03T01:52:06.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:51:00+00:00, run_id=scheduled__2024-04-03T01:51:00+00:00, run_start_date=2024-04-03 01:52:00.890361+00:00, run_end_date=2024-04-03 01:52:06.113225+00:00, run_duration=5.222864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:51:00+00:00, data_interval_end=2024-04-03 01:52:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:52:06.124811990Z [2024-04-03T01:52:06.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:52:00+00:00, run_after=2024-04-03T01:53:00+00:00 2024-04-03T01:52:06.134354388Z [2024-04-03T01:52:06.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:52:06.134419243Z [2024-04-03T01:52:06.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:51:00+00:00, run_id=scheduled__2024-04-03T01:51:00+00:00, run_start_date=2024-04-03 01:52:00.891371+00:00, run_end_date=2024-04-03 01:52:06.134090+00:00, run_duration=5.242719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:51:00+00:00, data_interval_end=2024-04-03 01:52:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:52:06.145436096Z [2024-04-03T01:52:06.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:52:00+00:00, run_after=2024-04-03T01:53:00+00:00 2024-04-03T01:52:06.188709552Z [2024-04-03T01:52:06.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:51:00+00:00 exited with status success for try_number 1 2024-04-03T01:52:06.188778400Z [2024-04-03T01:52:06.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:51:00+00:00 exited with status success for try_number 1 2024-04-03T01:52:06.197932568Z [2024-04-03T01:52:06.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:51:00+00:00, map_index=-1, run_start_date=2024-04-03 01:52:03.337722+00:00, run_end_date=2024-04-03 01:52:05.346857+00:00, run_duration=2.009135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:52:00.937121+00:00, queued_by_job_id=1, pid=2241 2024-04-03T01:52:06.198006884Z [2024-04-03T01:52:06.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:51:00+00:00, map_index=-1, run_start_date=2024-04-03 01:52:03.439038+00:00, run_end_date=2024-04-03 01:52:05.069852+00:00, run_duration=1.630814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:52:00.937121+00:00, queued_by_job_id=1, pid=2242 2024-04-03T01:53:00.651817370Z [2024-04-03T01:53:00.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:53:00+00:00, run_after=2024-04-03T01:54:00+00:00 2024-04-03T01:53:00.660945833Z [2024-04-03T01:53:00.660+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:53:00.709690284Z [2024-04-03T01:53:00.709+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:53:00.709720460Z 2024-04-03T01:53:00.709735068Z 2024-04-03T01:53:00.709748878Z [2024-04-03T01:53:00.709+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:53:00.709823284Z [2024-04-03T01:53:00.709+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:53:00.710425810Z [2024-04-03T01:53:00.710+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:53:00.710438291Z 2024-04-03T01:53:00.710442012Z 2024-04-03T01:53:00.713067773Z [2024-04-03T01:53:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:53:00.713249318Z [2024-04-03T01:53:00.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:53:00.713563379Z [2024-04-03T01:53:00.713+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:53:00.713708099Z [2024-04-03T01:53:00.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:53:01.025605049Z [2024-04-03T01:53:01.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:52:00+00:00 exited with status queued for try_number 1 2024-04-03T01:53:01.025681520Z [2024-04-03T01:53:01.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:52:00+00:00 exited with status queued for try_number 1 2024-04-03T01:53:01.032905797Z [2024-04-03T01:53:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb38f86a-479f-4386-97b0-576a65ad692f 2024-04-03T01:53:01.033045124Z [2024-04-03T01:53:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to efcdb372-2106-4366-a863-aba96b368efe 2024-04-03T01:53:05.879235421Z [2024-04-03T01:53:05.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:53:05.879532794Z [2024-04-03T01:53:05.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:52:00+00:00, run_id=scheduled__2024-04-03T01:52:00+00:00, run_start_date=2024-04-03 01:53:00.671197+00:00, run_end_date=2024-04-03 01:53:05.879152+00:00, run_duration=5.207955, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:52:00+00:00, data_interval_end=2024-04-03 01:53:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:53:05.889709276Z [2024-04-03T01:53:05.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:53:00+00:00, run_after=2024-04-03T01:54:00+00:00 2024-04-03T01:53:05.896536725Z [2024-04-03T01:53:05.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:53:05.896674754Z [2024-04-03T01:53:05.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:52:00+00:00, run_id=scheduled__2024-04-03T01:52:00+00:00, run_start_date=2024-04-03 01:53:00.672463+00:00, run_end_date=2024-04-03 01:53:05.896443+00:00, run_duration=5.22398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:52:00+00:00, data_interval_end=2024-04-03 01:53:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:53:05.906386090Z [2024-04-03T01:53:05.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:53:00+00:00, run_after=2024-04-03T01:54:00+00:00 2024-04-03T01:53:05.934668112Z [2024-04-03T01:53:05.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:52:00+00:00 exited with status success for try_number 1 2024-04-03T01:53:05.934947024Z [2024-04-03T01:53:05.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:52:00+00:00 exited with status success for try_number 1 2024-04-03T01:53:05.943029224Z [2024-04-03T01:53:05.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:52:00+00:00, map_index=-1, run_start_date=2024-04-03 01:53:02.988169+00:00, run_end_date=2024-04-03 01:53:04.859050+00:00, run_duration=1.870881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:53:00.710926+00:00, queued_by_job_id=1, pid=2296 2024-04-03T01:53:05.943393163Z [2024-04-03T01:53:05.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:52:00+00:00, map_index=-1, run_start_date=2024-04-03 01:53:03.034020+00:00, run_end_date=2024-04-03 01:53:05.170039+00:00, run_duration=2.136019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:53:00.710926+00:00, queued_by_job_id=1, pid=2297 2024-04-03T01:54:00.440983870Z [2024-04-03T01:54:00.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:54:00+00:00, run_after=2024-04-03T01:55:00+00:00 2024-04-03T01:54:00.453089007Z [2024-04-03T01:54:00.452+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:54:00.466479381Z [2024-04-03T01:54:00.466+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:54:00.602179223Z [2024-04-03T01:54:00.601+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:54:00.602210212Z 2024-04-03T01:54:00.602216708Z 2024-04-03T01:54:00.602221463Z 2024-04-03T01:54:00.602418086Z [2024-04-03T01:54:00.602+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:54:00.602713497Z [2024-04-03T01:54:00.602+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:54:00.602893906Z [2024-04-03T01:54:00.602+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:54:00.603818772Z [2024-04-03T01:54:00.603+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:54:00.603833699Z 2024-04-03T01:54:00.603839304Z 2024-04-03T01:54:00.603844131Z 2024-04-03T01:54:00.607746964Z [2024-04-03T01:54:00.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:54:00.608120484Z [2024-04-03T01:54:00.607+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:54:00.608786913Z [2024-04-03T01:54:00.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:54:00.609106827Z [2024-04-03T01:54:00.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:54:00.609414778Z [2024-04-03T01:54:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:54:00.609609261Z [2024-04-03T01:54:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:54:01.113016920Z [2024-04-03T01:54:01.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:52:00+00:00 exited with status queued for try_number 1 2024-04-03T01:54:01.113385846Z [2024-04-03T01:54:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:53:00+00:00 exited with status queued for try_number 1 2024-04-03T01:54:01.113513924Z [2024-04-03T01:54:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:53:00+00:00 exited with status queued for try_number 1 2024-04-03T01:54:01.137430876Z [2024-04-03T01:54:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5cf17c4-1497-4ff2-aca1-0f695de45127 2024-04-03T01:54:01.138484103Z [2024-04-03T01:54:01.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to bed6058a-7074-441f-bfbf-a9f3cb22a52f 2024-04-03T01:54:01.138713553Z [2024-04-03T01:54:01.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fa841a9-bff8-4945-9918-42b5250e3ada 2024-04-03T01:54:03.516108273Z [2024-04-03T01:54:03.514+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:54:03.516533898Z [2024-04-03T01:54:03.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:52:00+00:00, run_id=scheduled__2024-04-03T01:52:00+00:00, run_start_date=2024-04-03 01:54:00.482973+00:00, run_end_date=2024-04-03 01:54:03.515989+00:00, run_duration=3.033016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:52:00+00:00, data_interval_end=2024-04-03 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:54:03.526440511Z [2024-04-03T01:54:03.525+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:54:00+00:00, run_after=2024-04-03T01:56:00+00:00 2024-04-03T01:54:03.613703708Z [2024-04-03T01:54:03.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:52:00+00:00 exited with status success for try_number 1 2024-04-03T01:54:03.623752188Z [2024-04-03T01:54:03.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:52:00+00:00, map_index=-1, run_start_date=2024-04-03 01:54:01.950427+00:00, run_end_date=2024-04-03 01:54:02.522654+00:00, run_duration=0.572227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:54:00.604780+00:00, queued_by_job_id=1, pid=2333 2024-04-03T01:54:05.597062676Z [2024-04-03T01:54:05.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:54:05.597777028Z [2024-04-03T01:54:05.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:53:00+00:00, run_id=scheduled__2024-04-03T01:53:00+00:00, run_start_date=2024-04-03 01:54:00.486336+00:00, run_end_date=2024-04-03 01:54:05.596890+00:00, run_duration=5.110554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:53:00+00:00, data_interval_end=2024-04-03 01:54:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:54:05.609220238Z [2024-04-03T01:54:05.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:54:00+00:00, run_after=2024-04-03T01:55:00+00:00 2024-04-03T01:54:05.662886874Z [2024-04-03T01:54:05.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:53:00+00:00 exited with status success for try_number 1 2024-04-03T01:54:05.669097580Z [2024-04-03T01:54:05.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:53:00+00:00, map_index=-1, run_start_date=2024-04-03 01:54:03.353717+00:00, run_end_date=2024-04-03 01:54:05.296573+00:00, run_duration=1.942856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:54:00.604780+00:00, queued_by_job_id=1, pid=2353 2024-04-03T01:54:07.858789544Z [2024-04-03T01:54:07.858+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:54:07.858986231Z [2024-04-03T01:54:07.858+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:53:00+00:00, run_id=scheduled__2024-04-03T01:53:00+00:00, run_start_date=2024-04-03 01:54:00.484795+00:00, run_end_date=2024-04-03 01:54:07.858500+00:00, run_duration=7.373705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:53:00+00:00, data_interval_end=2024-04-03 01:54:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:54:07.882829865Z [2024-04-03T01:54:07.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:54:00+00:00, run_after=2024-04-03T01:55:00+00:00 2024-04-03T01:54:07.933866525Z [2024-04-03T01:54:07.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:53:00+00:00 exited with status success for try_number 1 2024-04-03T01:54:07.940704274Z [2024-04-03T01:54:07.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:53:00+00:00, map_index=-1, run_start_date=2024-04-03 01:54:04.521094+00:00, run_end_date=2024-04-03 01:54:06.739619+00:00, run_duration=2.218525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:54:00.604780+00:00, queued_by_job_id=1, pid=2372 2024-04-03T01:55:00.299684976Z [2024-04-03T01:55:00.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:55:00+00:00, run_after=2024-04-03T02:00:00+00:00 2024-04-03T01:55:00.309398919Z [2024-04-03T01:55:00.308+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:55:00.378358941Z [2024-04-03T01:55:00.378+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:55:00.378380855Z 2024-04-03T01:55:00.378385267Z 2024-04-03T01:55:00.378720085Z [2024-04-03T01:55:00.378+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:55:00.378937396Z [2024-04-03T01:55:00.378+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:55:00.379694308Z [2024-04-03T01:55:00.379+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:55:00.379705555Z 2024-04-03T01:55:00.379709164Z 2024-04-03T01:55:00.382969487Z [2024-04-03T01:55:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T01:55:00.383237949Z [2024-04-03T01:55:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:55:00.383578408Z [2024-04-03T01:55:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:55:00.383808565Z [2024-04-03T01:55:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:55:00.679048274Z [2024-04-03T01:55:00.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status queued for try_number 1 2024-04-03T01:55:00.679433540Z [2024-04-03T01:55:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:54:00+00:00 exited with status queued for try_number 1 2024-04-03T01:55:00.687226849Z [2024-04-03T01:55:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c7e8c97-9d81-4beb-8969-b548d244a9e7 2024-04-03T01:55:00.687530838Z [2024-04-03T01:55:00.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f9d26c9-8765-432f-8719-0a0cd806ad76 2024-04-03T01:55:00.787698488Z [2024-04-03T01:55:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:55:00+00:00, run_after=2024-04-03T01:56:00+00:00 2024-04-03T01:55:01.095494801Z [2024-04-03T01:55:01.093+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:55:01.095515790Z 2024-04-03T01:55:01.095778488Z [2024-04-03T01:55:01.095+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:55:01.098650762Z [2024-04-03T01:55:01.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:55:01.098665394Z 2024-04-03T01:55:01.101164398Z [2024-04-03T01:55:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:55:01.101864560Z [2024-04-03T01:55:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:55:01.223261192Z [2024-04-03T01:55:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:54:00+00:00 exited with status queued for try_number 1 2024-04-03T01:55:01.239686884Z [2024-04-03T01:55:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 434a99d2-a73e-409e-8bcd-d072000bb79b 2024-04-03T01:55:04.795256184Z [2024-04-03T01:55:04.794+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:55:04.795284838Z 2024-04-03T01:55:04.795290725Z [2024-04-03T01:55:04.795+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:55:04.795910347Z [2024-04-03T01:55:04.795+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:55:04.795947199Z 2024-04-03T01:55:04.798218876Z [2024-04-03T01:55:04.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T01:55:04.798245175Z [2024-04-03T01:55:04.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:55:04.870346548Z [2024-04-03T01:55:04.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status queued for try_number 1 2024-04-03T01:55:04.870368763Z [2024-04-03T01:55:04.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status success for try_number 1 2024-04-03T01:55:04.876476035Z [2024-04-03T01:55:04.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cc9ca0a-57f6-473e-94a3-499dafd347a6 2024-04-03T01:55:04.876592725Z [2024-04-03T01:55:04.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:50:00+00:00, map_index=-1, run_start_date=2024-04-03 01:55:03.732510+00:00, run_end_date=2024-04-03 01:55:04.308763+00:00, run_duration=0.576253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:55:00.380435+00:00, queued_by_job_id=1, pid=2421 2024-04-03T01:55:05.769509459Z [2024-04-03T01:55:05.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:55:05.769691862Z [2024-04-03T01:55:05.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:54:00+00:00, run_id=scheduled__2024-04-03T01:54:00+00:00, run_start_date=2024-04-03 01:55:00.322776+00:00, run_end_date=2024-04-03 01:55:05.769379+00:00, run_duration=5.446603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:54:00+00:00, data_interval_end=2024-04-03 01:55:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:55:05.794007994Z [2024-04-03T01:55:05.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:55:00+00:00, run_after=2024-04-03T01:56:00+00:00 2024-04-03T01:55:05.856750831Z [2024-04-03T01:55:05.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:54:00+00:00 exited with status success for try_number 1 2024-04-03T01:55:05.862748595Z [2024-04-03T01:55:05.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:54:00+00:00, map_index=-1, run_start_date=2024-04-03 01:55:03.430816+00:00, run_end_date=2024-04-03 01:55:05.426334+00:00, run_duration=1.995518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:55:00.380435+00:00, queued_by_job_id=1, pid=2420 2024-04-03T01:55:06.940371791Z [2024-04-03T01:55:06.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:55:06.940663449Z [2024-04-03T01:55:06.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:54:00+00:00, run_id=scheduled__2024-04-03T01:54:00+00:00, run_start_date=2024-04-03 01:55:00.879409+00:00, run_end_date=2024-04-03 01:55:06.940260+00:00, run_duration=6.060851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:54:00+00:00, data_interval_end=2024-04-03 01:55:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:55:06.952474873Z [2024-04-03T01:55:06.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:55:00+00:00, run_after=2024-04-03T01:56:00+00:00 2024-04-03T01:55:07.009601562Z [2024-04-03T01:55:07.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:54:00+00:00 exited with status success for try_number 1 2024-04-03T01:55:07.016262344Z [2024-04-03T01:55:07.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:54:00+00:00, map_index=-1, run_start_date=2024-04-03 01:55:04.584745+00:00, run_end_date=2024-04-03 01:55:06.693784+00:00, run_duration=2.109039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:55:01.099105+00:00, queued_by_job_id=1, pid=2449 2024-04-03T01:55:08.073674625Z [2024-04-03T01:55:08.073+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:55:08.073701531Z 2024-04-03T01:55:08.073934836Z [2024-04-03T01:55:08.073+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:55:08.074561660Z [2024-04-03T01:55:08.074+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:55:08.074569751Z 2024-04-03T01:55:08.077173545Z [2024-04-03T01:55:08.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T01:55:08.077383390Z [2024-04-03T01:55:08.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:55:08.131992195Z [2024-04-03T01:55:08.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status queued for try_number 1 2024-04-03T01:55:08.132090687Z [2024-04-03T01:55:08.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status success for try_number 1 2024-04-03T01:55:08.145713194Z [2024-04-03T01:55:08.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15616d9a-546e-4bb4-9b26-9cf678cd6f73 2024-04-03T01:55:08.145884845Z [2024-04-03T01:55:08.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T01:50:00+00:00, map_index=-1, run_start_date=2024-04-03 01:55:06.565595+00:00, run_end_date=2024-04-03 01:55:06.958823+00:00, run_duration=0.393228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:55:04.796152+00:00, queued_by_job_id=1, pid=2470 2024-04-03T01:55:10.899767570Z [2024-04-03T01:55:10.899+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T01:55:10.899789633Z 2024-04-03T01:55:10.899793605Z [2024-04-03T01:55:10.899+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:55:10.900506132Z [2024-04-03T01:55:10.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:55:10.900518779Z 2024-04-03T01:55:10.904923504Z [2024-04-03T01:55:10.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:55:10.904947337Z [2024-04-03T01:55:10.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:55:10.975198614Z [2024-04-03T01:55:10.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status queued for try_number 1 2024-04-03T01:55:10.975399463Z [2024-04-03T01:55:10.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status success for try_number 1 2024-04-03T01:55:10.982442039Z [2024-04-03T01:55:10.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7113ec49-91bd-414b-a7aa-0fff3b5a0b34 2024-04-03T01:55:10.982537621Z [2024-04-03T01:55:10.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:50:00+00:00, map_index=0, run_start_date=2024-04-03 01:55:09.933772+00:00, run_end_date=2024-04-03 01:55:10.398872+00:00, run_duration=0.4651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:55:08.075036+00:00, queued_by_job_id=1, pid=2482 2024-04-03T01:55:14.225855700Z [2024-04-03T01:55:14.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:55:14.226062826Z [2024-04-03T01:55:14.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:50:00+00:00, run_id=scheduled__2024-04-03T01:50:00+00:00, run_start_date=2024-04-03 01:55:00.321363+00:00, run_end_date=2024-04-03 01:55:14.225732+00:00, run_duration=13.904369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:50:00+00:00, data_interval_end=2024-04-03 01:55:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T01:55:14.231873843Z [2024-04-03T01:55:14.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:55:00+00:00, run_after=2024-04-03T02:00:00+00:00 2024-04-03T01:55:14.258448368Z [2024-04-03T01:55:14.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:50:00+00:00 exited with status success for try_number 1 2024-04-03T01:55:14.263192083Z [2024-04-03T01:55:14.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T01:50:00+00:00, map_index=-1, run_start_date=2024-04-03 01:55:12.872215+00:00, run_end_date=2024-04-03 01:55:13.235623+00:00, run_duration=0.363408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:55:10.901065+00:00, queued_by_job_id=1, pid=2494 2024-04-03T01:56:00.037544130Z [2024-04-03T01:56:00.036+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:56:00.062668151Z [2024-04-03T01:56:00.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:56:00+00:00, run_after=2024-04-03T01:57:00+00:00 2024-04-03T01:56:00.077495669Z [2024-04-03T01:56:00.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:56:00.248538436Z [2024-04-03T01:56:00.248+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:56:00.248570432Z 2024-04-03T01:56:00.248574921Z 2024-04-03T01:56:00.248578204Z 2024-04-03T01:56:00.248903728Z [2024-04-03T01:56:00.248+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:56:00.249233344Z [2024-04-03T01:56:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:56:00.249520378Z [2024-04-03T01:56:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:56:00.250488172Z [2024-04-03T01:56:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:56:00.250498968Z 2024-04-03T01:56:00.250502450Z 2024-04-03T01:56:00.250505815Z 2024-04-03T01:56:00.255164204Z [2024-04-03T01:56:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:56:00.255569471Z [2024-04-03T01:56:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:56:00.256095911Z [2024-04-03T01:56:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:56:00.256391608Z [2024-04-03T01:56:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:56:00.256849993Z [2024-04-03T01:56:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:56:00.257216030Z [2024-04-03T01:56:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:56:00.648490002Z [2024-04-03T01:56:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:54:00+00:00 exited with status queued for try_number 1 2024-04-03T01:56:00.648676781Z [2024-04-03T01:56:00.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status queued for try_number 1 2024-04-03T01:56:00.648827577Z [2024-04-03T01:56:00.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status queued for try_number 1 2024-04-03T01:56:00.656656548Z [2024-04-03T01:56:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b497823-7072-4c7f-aa21-219bdd5c86b7 2024-04-03T01:56:00.657110815Z [2024-04-03T01:56:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 189659b7-768d-4ba6-81e6-c7299548dff9 2024-04-03T01:56:00.657328861Z [2024-04-03T01:56:00.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to 290edbfa-5305-4d7b-b4c6-72bda85d49e7 2024-04-03T01:56:02.870061010Z [2024-04-03T01:56:02.869+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:56:02.872099926Z [2024-04-03T01:56:02.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:54:00+00:00, run_id=scheduled__2024-04-03T01:54:00+00:00, run_start_date=2024-04-03 01:56:00.090419+00:00, run_end_date=2024-04-03 01:56:02.869996+00:00, run_duration=2.779577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:54:00+00:00, data_interval_end=2024-04-03 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:56:02.881108116Z [2024-04-03T01:56:02.880+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:56:00+00:00, run_after=2024-04-03T01:58:00+00:00 2024-04-03T01:56:02.962254092Z [2024-04-03T01:56:02.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:54:00+00:00 exited with status success for try_number 1 2024-04-03T01:56:02.975332677Z [2024-04-03T01:56:02.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:54:00+00:00, map_index=-1, run_start_date=2024-04-03 01:56:01.488589+00:00, run_end_date=2024-04-03 01:56:02.239856+00:00, run_duration=0.751267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:56:00.251530+00:00, queued_by_job_id=1, pid=2511 2024-04-03T01:56:06.802423988Z [2024-04-03T01:56:06.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:56:06.803021716Z [2024-04-03T01:56:06.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:55:00+00:00, run_id=scheduled__2024-04-03T01:55:00+00:00, run_start_date=2024-04-03 01:56:00.092397+00:00, run_end_date=2024-04-03 01:56:06.802535+00:00, run_duration=6.710138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:55:00+00:00, data_interval_end=2024-04-03 01:56:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:56:06.812842620Z [2024-04-03T01:56:06.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:56:00+00:00, run_after=2024-04-03T01:57:00+00:00 2024-04-03T01:56:06.872616260Z [2024-04-03T01:56:06.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status success for try_number 1 2024-04-03T01:56:06.877982508Z [2024-04-03T01:56:06.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:55:00+00:00, map_index=-1, run_start_date=2024-04-03 01:56:03.255258+00:00, run_end_date=2024-04-03 01:56:06.354134+00:00, run_duration=3.098876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:56:00.251530+00:00, queued_by_job_id=1, pid=2541 2024-04-03T01:56:07.923361890Z [2024-04-03T01:56:07.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:56:07.923523347Z [2024-04-03T01:56:07.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:55:00+00:00, run_id=scheduled__2024-04-03T01:55:00+00:00, run_start_date=2024-04-03 01:56:00.093656+00:00, run_end_date=2024-04-03 01:56:07.923250+00:00, run_duration=7.829594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:55:00+00:00, data_interval_end=2024-04-03 01:56:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:56:07.932781522Z [2024-04-03T01:56:07.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:56:00+00:00, run_after=2024-04-03T01:57:00+00:00 2024-04-03T01:56:07.960824107Z [2024-04-03T01:56:07.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status success for try_number 1 2024-04-03T01:56:07.965401417Z [2024-04-03T01:56:07.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:55:00+00:00, map_index=-1, run_start_date=2024-04-03 01:56:03.345583+00:00, run_end_date=2024-04-03 01:56:06.941496+00:00, run_duration=3.595913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:56:00.251530+00:00, queued_by_job_id=1, pid=2542 2024-04-03T01:56:35.075438127Z [2024-04-03T01:56:35.070+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T01:57:00.316229633Z [2024-04-03T01:57:00.315+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:57:00.333557026Z [2024-04-03T01:57:00.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:57:00+00:00, run_after=2024-04-03T01:58:00+00:00 2024-04-03T01:57:00.386113947Z [2024-04-03T01:57:00.385+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:57:00.386179947Z 2024-04-03T01:57:00.386185523Z 2024-04-03T01:57:00.386258780Z [2024-04-03T01:57:00.385+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:57:00.386453525Z [2024-04-03T01:57:00.386+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:57:00.387236649Z [2024-04-03T01:57:00.387+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:57:00.387251679Z 2024-04-03T01:57:00.387256899Z 2024-04-03T01:57:00.396251846Z [2024-04-03T01:57:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:57:00.396420242Z [2024-04-03T01:57:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:57:00.396657664Z [2024-04-03T01:57:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:57:00.396784749Z [2024-04-03T01:57:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:57:00.648857307Z [2024-04-03T01:57:00.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:56:00+00:00 exited with status queued for try_number 1 2024-04-03T01:57:00.649002836Z [2024-04-03T01:57:00.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:56:00+00:00 exited with status queued for try_number 1 2024-04-03T01:57:00.667653740Z [2024-04-03T01:57:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84a01fa1-7b00-489a-83a9-1974e05ed2a5 2024-04-03T01:57:00.667996141Z [2024-04-03T01:57:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 022a67d7-0f38-4b0b-942b-747e7ec091af 2024-04-03T01:57:04.802926944Z [2024-04-03T01:57:04.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:57:04.803604276Z [2024-04-03T01:57:04.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:56:00+00:00, run_id=scheduled__2024-04-03T01:56:00+00:00, run_start_date=2024-04-03 01:57:00.347428+00:00, run_end_date=2024-04-03 01:57:04.802763+00:00, run_duration=4.455335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:56:00+00:00, data_interval_end=2024-04-03 01:57:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:57:04.814417024Z [2024-04-03T01:57:04.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:57:00+00:00, run_after=2024-04-03T01:58:00+00:00 2024-04-03T01:57:04.821356200Z [2024-04-03T01:57:04.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:57:04.822035492Z [2024-04-03T01:57:04.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:56:00+00:00, run_id=scheduled__2024-04-03T01:56:00+00:00, run_start_date=2024-04-03 01:57:00.348753+00:00, run_end_date=2024-04-03 01:57:04.821275+00:00, run_duration=4.472522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:56:00+00:00, data_interval_end=2024-04-03 01:57:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:57:04.834580337Z [2024-04-03T01:57:04.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:57:00+00:00, run_after=2024-04-03T01:58:00+00:00 2024-04-03T01:57:04.865739149Z [2024-04-03T01:57:04.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:56:00+00:00 exited with status success for try_number 1 2024-04-03T01:57:04.865773827Z [2024-04-03T01:57:04.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:56:00+00:00 exited with status success for try_number 1 2024-04-03T01:57:04.873255892Z [2024-04-03T01:57:04.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:56:00+00:00, map_index=-1, run_start_date=2024-04-03 01:57:02.507684+00:00, run_end_date=2024-04-03 01:57:04.157965+00:00, run_duration=1.650281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:57:00.387879+00:00, queued_by_job_id=1, pid=2595 2024-04-03T01:57:04.873546047Z [2024-04-03T01:57:04.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:56:00+00:00, map_index=-1, run_start_date=2024-04-03 01:57:02.511129+00:00, run_end_date=2024-04-03 01:57:03.845559+00:00, run_duration=1.33443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:57:00.387879+00:00, queued_by_job_id=1, pid=2596 2024-04-03T01:58:00.673358413Z [2024-04-03T01:58:00.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:58:00+00:00, run_after=2024-04-03T01:59:00+00:00 2024-04-03T01:58:00.684240247Z [2024-04-03T01:58:00.683+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:58:00.690821831Z [2024-04-03T01:58:00.690+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:58:00.804755288Z [2024-04-03T01:58:00.804+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T01:58:00.804780656Z 2024-04-03T01:58:00.804794300Z 2024-04-03T01:58:00.804797741Z 2024-04-03T01:58:00.804812072Z [2024-04-03T01:58:00.804+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T01:58:00.804815525Z [2024-04-03T01:58:00.804+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:58:00.804818548Z [2024-04-03T01:58:00.804+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:58:00.806112430Z [2024-04-03T01:58:00.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:58:00.806127439Z 2024-04-03T01:58:00.806131180Z 2024-04-03T01:58:00.806134237Z 2024-04-03T01:58:00.816574313Z [2024-04-03T01:58:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:58:00.817071377Z [2024-04-03T01:58:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:58:00.817409478Z [2024-04-03T01:58:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:58:00.817568473Z [2024-04-03T01:58:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:58:00.817904597Z [2024-04-03T01:58:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:58:00.818071766Z [2024-04-03T01:58:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:58:01.181757340Z [2024-04-03T01:58:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:56:00+00:00 exited with status queued for try_number 1 2024-04-03T01:58:01.181929621Z [2024-04-03T01:58:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:57:00+00:00 exited with status queued for try_number 1 2024-04-03T01:58:01.182098522Z [2024-04-03T01:58:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:57:00+00:00 exited with status queued for try_number 1 2024-04-03T01:58:01.192394329Z [2024-04-03T01:58:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1803c97b-ecb4-4f59-a7be-e884653c72d6 2024-04-03T01:58:01.192583496Z [2024-04-03T01:58:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7468b1b3-5073-4b26-afb4-8519c8e0e37e 2024-04-03T01:58:01.192934941Z [2024-04-03T01:58:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 287eff60-d049-43d1-8447-3f19817fe0fa 2024-04-03T01:58:02.469698998Z [2024-04-03T01:58:02.469+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:58:02.470252952Z [2024-04-03T01:58:02.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:56:00+00:00, run_id=scheduled__2024-04-03T01:56:00+00:00, run_start_date=2024-04-03 01:58:00.702741+00:00, run_end_date=2024-04-03 01:58:02.469619+00:00, run_duration=1.766878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:56:00+00:00, data_interval_end=2024-04-03 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T01:58:02.480082470Z [2024-04-03T01:58:02.479+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T01:58:00+00:00, run_after=2024-04-03T02:00:00+00:00 2024-04-03T01:58:02.542947518Z [2024-04-03T01:58:02.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:56:00+00:00 exited with status success for try_number 1 2024-04-03T01:58:02.551138917Z [2024-04-03T01:58:02.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:56:00+00:00, map_index=-1, run_start_date=2024-04-03 01:58:01.638197+00:00, run_end_date=2024-04-03 01:58:02.013460+00:00, run_duration=0.375263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:58:00.806907+00:00, queued_by_job_id=1, pid=2632 2024-04-03T01:58:05.711894179Z [2024-04-03T01:58:05.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:58:05.712625695Z [2024-04-03T01:58:05.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:57:00+00:00, run_id=scheduled__2024-04-03T01:57:00+00:00, run_start_date=2024-04-03 01:58:00.707326+00:00, run_end_date=2024-04-03 01:58:05.711795+00:00, run_duration=5.004469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:57:00+00:00, data_interval_end=2024-04-03 01:58:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:58:05.730289762Z [2024-04-03T01:58:05.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:58:00+00:00, run_after=2024-04-03T01:59:00+00:00 2024-04-03T01:58:05.741182825Z [2024-04-03T01:58:05.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:58:05.741938109Z [2024-04-03T01:58:05.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:57:00+00:00, run_id=scheduled__2024-04-03T01:57:00+00:00, run_start_date=2024-04-03 01:58:00.705299+00:00, run_end_date=2024-04-03 01:58:05.741342+00:00, run_duration=5.036043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:57:00+00:00, data_interval_end=2024-04-03 01:58:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:58:05.763688241Z [2024-04-03T01:58:05.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:58:00+00:00, run_after=2024-04-03T01:59:00+00:00 2024-04-03T01:58:05.802376859Z [2024-04-03T01:58:05.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:57:00+00:00 exited with status success for try_number 1 2024-04-03T01:58:05.802716142Z [2024-04-03T01:58:05.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:57:00+00:00 exited with status success for try_number 1 2024-04-03T01:58:05.810926964Z [2024-04-03T01:58:05.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:57:00+00:00, map_index=-1, run_start_date=2024-04-03 01:58:03.063488+00:00, run_end_date=2024-04-03 01:58:05.169983+00:00, run_duration=2.106495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:58:00.806907+00:00, queued_by_job_id=1, pid=2653 2024-04-03T01:58:05.811292198Z [2024-04-03T01:58:05.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:57:00+00:00, map_index=-1, run_start_date=2024-04-03 01:58:03.445715+00:00, run_end_date=2024-04-03 01:58:05.551057+00:00, run_duration=2.105342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:58:00.806907+00:00, queued_by_job_id=1, pid=2663 2024-04-03T01:59:01.045993825Z [2024-04-03T01:59:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:59:00+00:00, run_after=2024-04-03T02:00:00+00:00 2024-04-03T01:59:01.053778049Z [2024-04-03T01:59:01.053+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T01:59:01.105454267Z [2024-04-03T01:59:01.105+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T01:59:01.105498525Z 2024-04-03T01:59:01.105557812Z 2024-04-03T01:59:01.105591278Z [2024-04-03T01:59:01.105+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:59:01.105938087Z [2024-04-03T01:59:01.105+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T01:59:01.107051258Z [2024-04-03T01:59:01.106+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T01:59:01.107071279Z 2024-04-03T01:59:01.107075766Z 2024-04-03T01:59:01.110816151Z [2024-04-03T01:59:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:59:01.111010301Z [2024-04-03T01:59:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:59:01.111347270Z [2024-04-03T01:59:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T01:59:01.111491187Z [2024-04-03T01:59:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:59:01.403542630Z [2024-04-03T01:59:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:58:00+00:00 exited with status queued for try_number 1 2024-04-03T01:59:01.403589065Z [2024-04-03T01:59:01.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:58:00+00:00 exited with status queued for try_number 1 2024-04-03T01:59:01.420181691Z [2024-04-03T01:59:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79d08cbc-d0a1-4877-9c15-781cdbf868a2 2024-04-03T01:59:01.420293523Z [2024-04-03T01:59:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f7492c1-dcf4-4d25-9268-665d25eb3070 2024-04-03T01:59:06.509216667Z [2024-04-03T01:59:06.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:59:06.509629144Z [2024-04-03T01:59:06.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:58:00+00:00, run_id=scheduled__2024-04-03T01:58:00+00:00, run_start_date=2024-04-03 01:59:01.063213+00:00, run_end_date=2024-04-03 01:59:06.509096+00:00, run_duration=5.445883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:58:00+00:00, data_interval_end=2024-04-03 01:59:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T01:59:06.519307365Z [2024-04-03T01:59:06.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:59:00+00:00, run_after=2024-04-03T02:00:00+00:00 2024-04-03T01:59:06.525923227Z [2024-04-03T01:59:06.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T01:59:06.526294371Z [2024-04-03T01:59:06.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:58:00+00:00, run_id=scheduled__2024-04-03T01:58:00+00:00, run_start_date=2024-04-03 01:59:01.064319+00:00, run_end_date=2024-04-03 01:59:06.525879+00:00, run_duration=5.46156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:58:00+00:00, data_interval_end=2024-04-03 01:59:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T01:59:06.536019652Z [2024-04-03T01:59:06.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T01:59:00+00:00, run_after=2024-04-03T02:00:00+00:00 2024-04-03T01:59:06.565134511Z [2024-04-03T01:59:06.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:58:00+00:00 exited with status success for try_number 1 2024-04-03T01:59:06.565227901Z [2024-04-03T01:59:06.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:58:00+00:00 exited with status success for try_number 1 2024-04-03T01:59:06.571736056Z [2024-04-03T01:59:06.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:58:00+00:00, map_index=-1, run_start_date=2024-04-03 01:59:03.076210+00:00, run_end_date=2024-04-03 01:59:05.330392+00:00, run_duration=2.254182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:59:01.107813+00:00, queued_by_job_id=1, pid=2718 2024-04-03T01:59:06.572071568Z [2024-04-03T01:59:06.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:58:00+00:00, map_index=-1, run_start_date=2024-04-03 01:59:02.998690+00:00, run_end_date=2024-04-03 01:59:05.557384+00:00, run_duration=2.558694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 01:59:01.107813+00:00, queued_by_job_id=1, pid=2717 2024-04-03T02:00:00.061587642Z [2024-04-03T02:00:00.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:00:00+00:00, run_after=2024-04-03T02:01:00+00:00 2024-04-03T02:00:00.071535813Z [2024-04-03T02:00:00.071+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:00:00.172467074Z [2024-04-03T02:00:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:00:00+00:00, run_after=2024-04-03T02:05:00+00:00 2024-04-03T02:00:00.202811051Z [2024-04-03T02:00:00.202+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:00:00.318833494Z [2024-04-03T02:00:00.318+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T02:00:00.318874121Z 2024-04-03T02:00:00.318880565Z 2024-04-03T02:00:00.318887450Z 2024-04-03T02:00:00.318893203Z 2024-04-03T02:00:00.319169839Z [2024-04-03T02:00:00.318+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:00:00.319309837Z [2024-04-03T02:00:00.319+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:00:00.319444470Z [2024-04-03T02:00:00.319+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:00:00.319578200Z [2024-04-03T02:00:00.319+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:00:00.320421400Z [2024-04-03T02:00:00.320+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:00:00.320435434Z 2024-04-03T02:00:00.320442607Z 2024-04-03T02:00:00.320448238Z 2024-04-03T02:00:00.320453837Z 2024-04-03T02:00:00.326212611Z [2024-04-03T02:00:00.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:00:00.326381150Z [2024-04-03T02:00:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:00:00.326815368Z [2024-04-03T02:00:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:00:00.327053452Z [2024-04-03T02:00:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:00:00.327346427Z [2024-04-03T02:00:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:00:00.327631083Z [2024-04-03T02:00:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:00:00.329975394Z [2024-04-03T02:00:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:00:00.329995146Z [2024-04-03T02:00:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:00:00.905539566Z [2024-04-03T02:00:00.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status queued for try_number 1 2024-04-03T02:00:00.905959354Z [2024-04-03T02:00:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:58:00+00:00 exited with status queued for try_number 1 2024-04-03T02:00:00.906186129Z [2024-04-03T02:00:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:59:00+00:00 exited with status queued for try_number 1 2024-04-03T02:00:00.906434860Z [2024-04-03T02:00:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:59:00+00:00 exited with status queued for try_number 1 2024-04-03T02:00:00.927994277Z [2024-04-03T02:00:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb056635-deeb-4d98-a8ce-294db2ef906c 2024-04-03T02:00:00.928316343Z [2024-04-03T02:00:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bb9b008-e04f-4f7f-a890-0180e970f812 2024-04-03T02:00:00.928572340Z [2024-04-03T02:00:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1b0739b-1afd-4956-bc29-50cf6bdec866 2024-04-03T02:00:00.928861467Z [2024-04-03T02:00:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f5a2cc9-c7bc-460d-829a-a04adf6d736b 2024-04-03T02:00:03.554092982Z [2024-04-03T02:00:03.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:00:03.554346614Z [2024-04-03T02:00:03.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 01:58:00+00:00, run_id=scheduled__2024-04-03T01:58:00+00:00, run_start_date=2024-04-03 02:00:00.225064+00:00, run_end_date=2024-04-03 02:00:03.554032+00:00, run_duration=3.328968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:58:00+00:00, data_interval_end=2024-04-03 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:00:03.573113873Z [2024-04-03T02:00:03.572+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:00:00+00:00, run_after=2024-04-03T02:02:00+00:00 2024-04-03T02:00:03.715456826Z [2024-04-03T02:00:03.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T01:58:00+00:00 exited with status success for try_number 1 2024-04-03T02:00:03.726997955Z [2024-04-03T02:00:03.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T01:58:00+00:00, map_index=-1, run_start_date=2024-04-03 02:00:02.274241+00:00, run_end_date=2024-04-03 02:00:02.832461+00:00, run_duration=0.55822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:00:00.321623+00:00, queued_by_job_id=1, pid=2756 2024-04-03T02:00:04.831182646Z [2024-04-03T02:00:04.830+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:00:04.831206651Z 2024-04-03T02:00:04.831236247Z [2024-04-03T02:00:04.831+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:00:04.831836769Z [2024-04-03T02:00:04.831+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:00:04.831867851Z 2024-04-03T02:00:04.834855121Z [2024-04-03T02:00:04.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:00:04.834945960Z [2024-04-03T02:00:04.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:00:04.904267520Z [2024-04-03T02:00:04.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status queued for try_number 1 2024-04-03T02:00:04.904291237Z [2024-04-03T02:00:04.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status success for try_number 1 2024-04-03T02:00:04.912302245Z [2024-04-03T02:00:04.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfe60145-6121-4c95-9aa0-788dddd8c1f0 2024-04-03T02:00:04.912680799Z [2024-04-03T02:00:04.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T01:55:00+00:00, map_index=-1, run_start_date=2024-04-03 02:00:03.723151+00:00, run_end_date=2024-04-03 02:00:04.174925+00:00, run_duration=0.451774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:00:00.321623+00:00, queued_by_job_id=1, pid=2805 2024-04-03T02:00:04.977711258Z [2024-04-03T02:00:04.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:00:04.978218180Z [2024-04-03T02:00:04.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:59:00+00:00, run_id=scheduled__2024-04-03T01:59:00+00:00, run_start_date=2024-04-03 02:00:00.226875+00:00, run_end_date=2024-04-03 02:00:04.977755+00:00, run_duration=4.75088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:59:00+00:00, data_interval_end=2024-04-03 02:00:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:00:04.987689682Z [2024-04-03T02:00:04.987+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:00:00+00:00, run_after=2024-04-03T02:01:00+00:00 2024-04-03T02:00:05.041684248Z [2024-04-03T02:00:05.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:59:00+00:00 exited with status success for try_number 1 2024-04-03T02:00:05.047957783Z [2024-04-03T02:00:05.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:59:00+00:00, map_index=-1, run_start_date=2024-04-03 02:00:03.168192+00:00, run_end_date=2024-04-03 02:00:04.812155+00:00, run_duration=1.643963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:00:00.321623+00:00, queued_by_job_id=1, pid=2776 2024-04-03T02:00:06.039720543Z [2024-04-03T02:00:06.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:00:06.040787159Z [2024-04-03T02:00:06.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:59:00+00:00, run_id=scheduled__2024-04-03T01:59:00+00:00, run_start_date=2024-04-03 02:00:00.228031+00:00, run_end_date=2024-04-03 02:00:06.039906+00:00, run_duration=5.811875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:59:00+00:00, data_interval_end=2024-04-03 02:00:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:00:06.052537033Z [2024-04-03T02:00:06.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:00:00+00:00, run_after=2024-04-03T02:01:00+00:00 2024-04-03T02:00:06.120335363Z [2024-04-03T02:00:06.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T01:59:00+00:00 exited with status success for try_number 1 2024-04-03T02:00:06.128927401Z [2024-04-03T02:00:06.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T01:59:00+00:00, map_index=-1, run_start_date=2024-04-03 02:00:03.650542+00:00, run_end_date=2024-04-03 02:00:05.518392+00:00, run_duration=1.86785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:00:00.321623+00:00, queued_by_job_id=1, pid=2804 2024-04-03T02:00:08.304740431Z [2024-04-03T02:00:08.304+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:00:08.304791524Z 2024-04-03T02:00:08.305086740Z [2024-04-03T02:00:08.304+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:00:08.305896722Z [2024-04-03T02:00:08.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:00:08.305961915Z 2024-04-03T02:00:08.309243616Z [2024-04-03T02:00:08.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:00:08.309276161Z [2024-04-03T02:00:08.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:00:08.386436339Z [2024-04-03T02:00:08.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status queued for try_number 1 2024-04-03T02:00:08.389460491Z [2024-04-03T02:00:08.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status success for try_number 1 2024-04-03T02:00:08.398320465Z [2024-04-03T02:00:08.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8742bd43-0d43-4676-9ed6-3c839d5d6051 2024-04-03T02:00:08.399078340Z [2024-04-03T02:00:08.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T01:55:00+00:00, map_index=-1, run_start_date=2024-04-03 02:00:06.710789+00:00, run_end_date=2024-04-03 02:00:07.084325+00:00, run_duration=0.373536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:00:04.832152+00:00, queued_by_job_id=1, pid=2835 2024-04-03T02:00:11.129332123Z [2024-04-03T02:00:11.128+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:00:11.129364781Z 2024-04-03T02:00:11.129422824Z [2024-04-03T02:00:11.129+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:00:11.129883133Z [2024-04-03T02:00:11.129+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:00:11.129892734Z 2024-04-03T02:00:11.132606013Z [2024-04-03T02:00:11.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:00:11.132808537Z [2024-04-03T02:00:11.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:00:11.225462961Z [2024-04-03T02:00:11.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status queued for try_number 1 2024-04-03T02:00:11.225560791Z [2024-04-03T02:00:11.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status success for try_number 1 2024-04-03T02:00:11.233075384Z [2024-04-03T02:00:11.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27b7697e-5356-4414-a57b-b0271568f86e 2024-04-03T02:00:11.233226466Z [2024-04-03T02:00:11.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T01:55:00+00:00, map_index=0, run_start_date=2024-04-03 02:00:10.511855+00:00, run_end_date=2024-04-03 02:00:10.993852+00:00, run_duration=0.481997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:00:08.306409+00:00, queued_by_job_id=1, pid=2847 2024-04-03T02:00:14.284309475Z [2024-04-03T02:00:14.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:00:14.284584395Z [2024-04-03T02:00:14.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 01:55:00+00:00, run_id=scheduled__2024-04-03T01:55:00+00:00, run_start_date=2024-04-03 02:00:00.223600+00:00, run_end_date=2024-04-03 02:00:14.284156+00:00, run_duration=14.060556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 01:55:00+00:00, data_interval_end=2024-04-03 02:00:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:00:14.294215339Z [2024-04-03T02:00:14.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:00:00+00:00, run_after=2024-04-03T02:05:00+00:00 2024-04-03T02:00:14.329742158Z [2024-04-03T02:00:14.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T01:55:00+00:00 exited with status success for try_number 1 2024-04-03T02:00:14.334694309Z [2024-04-03T02:00:14.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T01:55:00+00:00, map_index=-1, run_start_date=2024-04-03 02:00:13.608498+00:00, run_end_date=2024-04-03 02:00:13.987142+00:00, run_duration=0.378644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:00:11.130282+00:00, queued_by_job_id=1, pid=2859 2024-04-03T02:01:00.554382199Z [2024-04-03T02:01:00.553+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:01:00.567798868Z [2024-04-03T02:01:00.567+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:01:00+00:00, run_after=2024-04-03T02:02:00+00:00 2024-04-03T02:01:00.630055232Z [2024-04-03T02:01:00.629+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:01:00.630087296Z 2024-04-03T02:01:00.630093416Z 2024-04-03T02:01:00.630098982Z [2024-04-03T02:01:00.629+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:01:00.630191762Z [2024-04-03T02:01:00.630+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:01:00.630954722Z [2024-04-03T02:01:00.630+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:01:00.630968846Z 2024-04-03T02:01:00.630974427Z 2024-04-03T02:01:00.634334417Z [2024-04-03T02:01:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:01:00.634481030Z [2024-04-03T02:01:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:01:00.635588704Z [2024-04-03T02:01:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:01:00.635606297Z [2024-04-03T02:01:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:01:00.931063943Z [2024-04-03T02:01:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status queued for try_number 1 2024-04-03T02:01:00.931153564Z [2024-04-03T02:01:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status queued for try_number 1 2024-04-03T02:01:00.942424181Z [2024-04-03T02:01:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33694f3f-5dc7-46d1-9d12-d5a6ed9e6b15 2024-04-03T02:01:00.942720069Z [2024-04-03T02:01:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2c5b02f-9b76-47a6-95b2-b1db159fe1ff 2024-04-03T02:01:04.228184498Z [2024-04-03T02:01:04.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:01:04.228369932Z [2024-04-03T02:01:04.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:00:00+00:00, run_id=scheduled__2024-04-03T02:00:00+00:00, run_start_date=2024-04-03 02:01:00.579170+00:00, run_end_date=2024-04-03 02:01:04.227977+00:00, run_duration=3.648807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:00:00+00:00, data_interval_end=2024-04-03 02:01:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:01:04.239249938Z [2024-04-03T02:01:04.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:01:00+00:00, run_after=2024-04-03T02:02:00+00:00 2024-04-03T02:01:04.300508627Z [2024-04-03T02:01:04.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status success for try_number 1 2024-04-03T02:01:04.306252570Z [2024-04-03T02:01:04.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:00:00+00:00, map_index=-1, run_start_date=2024-04-03 02:01:02.660989+00:00, run_end_date=2024-04-03 02:01:03.954109+00:00, run_duration=1.29312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:01:00.631490+00:00, queued_by_job_id=1, pid=2896 2024-04-03T02:01:05.358322408Z [2024-04-03T02:01:05.357+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:01:05.358859752Z [2024-04-03T02:01:05.358+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:00:00+00:00, run_id=scheduled__2024-04-03T02:00:00+00:00, run_start_date=2024-04-03 02:01:00.577807+00:00, run_end_date=2024-04-03 02:01:05.358089+00:00, run_duration=4.780282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:00:00+00:00, data_interval_end=2024-04-03 02:01:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:01:05.377686140Z [2024-04-03T02:01:05.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:01:00+00:00, run_after=2024-04-03T02:02:00+00:00 2024-04-03T02:01:05.443394386Z [2024-04-03T02:01:05.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status success for try_number 1 2024-04-03T02:01:05.450797090Z [2024-04-03T02:01:05.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:00:00+00:00, map_index=-1, run_start_date=2024-04-03 02:01:02.658644+00:00, run_end_date=2024-04-03 02:01:04.298207+00:00, run_duration=1.639563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:01:00.631490+00:00, queued_by_job_id=1, pid=2895 2024-04-03T02:01:35.135518418Z [2024-04-03T02:01:35.134+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:02:00.795647244Z [2024-04-03T02:02:00.795+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:02:00.824979524Z [2024-04-03T02:02:00.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:02:00+00:00, run_after=2024-04-03T02:03:00+00:00 2024-04-03T02:02:00.829361203Z [2024-04-03T02:02:00.828+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:02:00.906257733Z [2024-04-03T02:02:00.905+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:02:00.906281480Z 2024-04-03T02:02:00.906287014Z 2024-04-03T02:02:00.906291847Z 2024-04-03T02:02:00.906346613Z [2024-04-03T02:02:00.906+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:02:00.906353243Z [2024-04-03T02:02:00.906+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:02:00.906424498Z [2024-04-03T02:02:00.906+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:02:00.907293751Z [2024-04-03T02:02:00.907+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:02:00.907306424Z 2024-04-03T02:02:00.907309879Z 2024-04-03T02:02:00.907312963Z 2024-04-03T02:02:00.911068647Z [2024-04-03T02:02:00.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:02:00.911178333Z [2024-04-03T02:02:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:02:00.911378505Z [2024-04-03T02:02:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:02:00.911463914Z [2024-04-03T02:02:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:02:00.911631806Z [2024-04-03T02:02:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:02:00.911695986Z [2024-04-03T02:02:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:02:01.251800977Z [2024-04-03T02:02:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status queued for try_number 1 2024-04-03T02:02:01.251874625Z [2024-04-03T02:02:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:01:00+00:00 exited with status queued for try_number 1 2024-04-03T02:02:01.251903455Z [2024-04-03T02:02:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:01:00+00:00 exited with status queued for try_number 1 2024-04-03T02:02:01.263284255Z [2024-04-03T02:02:01.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c54fc3d-30df-416c-b6f4-48cc16543ac4 2024-04-03T02:02:01.263373378Z [2024-04-03T02:02:01.263+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ad7918e-6f89-45ed-9fc9-6f7378e5c265 2024-04-03T02:02:01.263424329Z [2024-04-03T02:02:01.263+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e2f69db-5f6c-4635-9077-6ebab6a26e74 2024-04-03T02:02:02.803582989Z [2024-04-03T02:02:02.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:02:02.804630241Z [2024-04-03T02:02:02.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:00:00+00:00, run_id=scheduled__2024-04-03T02:00:00+00:00, run_start_date=2024-04-03 02:02:00.845635+00:00, run_end_date=2024-04-03 02:02:02.803536+00:00, run_duration=1.957901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:00:00+00:00, data_interval_end=2024-04-03 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:02:02.814701557Z [2024-04-03T02:02:02.810+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:02:00+00:00, run_after=2024-04-03T02:04:00+00:00 2024-04-03T02:02:02.862783292Z [2024-04-03T02:02:02.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status success for try_number 1 2024-04-03T02:02:02.873462171Z [2024-04-03T02:02:02.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:00:00+00:00, map_index=-1, run_start_date=2024-04-03 02:02:01.998224+00:00, run_end_date=2024-04-03 02:02:02.362753+00:00, run_duration=0.364529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:02:00.908130+00:00, queued_by_job_id=1, pid=2930 2024-04-03T02:02:05.028928397Z [2024-04-03T02:02:05.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:02:05.029407169Z [2024-04-03T02:02:05.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:01:00+00:00, run_id=scheduled__2024-04-03T02:01:00+00:00, run_start_date=2024-04-03 02:02:00.848266+00:00, run_end_date=2024-04-03 02:02:05.028816+00:00, run_duration=4.18055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:01:00+00:00, data_interval_end=2024-04-03 02:02:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:02:05.042762076Z [2024-04-03T02:02:05.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:02:00+00:00, run_after=2024-04-03T02:03:00+00:00 2024-04-03T02:02:05.093273810Z [2024-04-03T02:02:05.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:01:00+00:00 exited with status success for try_number 1 2024-04-03T02:02:05.099751583Z [2024-04-03T02:02:05.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:01:00+00:00, map_index=-1, run_start_date=2024-04-03 02:02:03.325165+00:00, run_end_date=2024-04-03 02:02:04.698883+00:00, run_duration=1.373718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:02:00.908130+00:00, queued_by_job_id=1, pid=2960 2024-04-03T02:02:06.152627824Z [2024-04-03T02:02:06.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:02:06.152745575Z [2024-04-03T02:02:06.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:01:00+00:00, run_id=scheduled__2024-04-03T02:01:00+00:00, run_start_date=2024-04-03 02:02:00.847285+00:00, run_end_date=2024-04-03 02:02:06.152338+00:00, run_duration=5.305053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:01:00+00:00, data_interval_end=2024-04-03 02:02:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:02:06.162876787Z [2024-04-03T02:02:06.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:02:00+00:00, run_after=2024-04-03T02:03:00+00:00 2024-04-03T02:02:06.202237908Z [2024-04-03T02:02:06.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:01:00+00:00 exited with status success for try_number 1 2024-04-03T02:02:06.207864182Z [2024-04-03T02:02:06.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:01:00+00:00, map_index=-1, run_start_date=2024-04-03 02:02:03.439386+00:00, run_end_date=2024-04-03 02:02:05.071603+00:00, run_duration=1.632217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:02:00.908130+00:00, queued_by_job_id=1, pid=2961 2024-04-03T02:03:01.026116193Z [2024-04-03T02:03:01.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:03:00+00:00, run_after=2024-04-03T02:04:00+00:00 2024-04-03T02:03:01.033664523Z [2024-04-03T02:03:01.033+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:03:01.083088875Z [2024-04-03T02:03:01.082+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:03:01.083168406Z 2024-04-03T02:03:01.083200970Z 2024-04-03T02:03:01.083221725Z [2024-04-03T02:03:01.082+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:03:01.083235996Z [2024-04-03T02:03:01.083+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:03:01.083738991Z [2024-04-03T02:03:01.083+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:03:01.083753847Z 2024-04-03T02:03:01.083760617Z 2024-04-03T02:03:01.086513114Z [2024-04-03T02:03:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:03:01.086584129Z [2024-04-03T02:03:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:03:01.086882451Z [2024-04-03T02:03:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:03:01.086933747Z [2024-04-03T02:03:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:03:01.306001670Z [2024-04-03T02:03:01.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:02:00+00:00 exited with status queued for try_number 1 2024-04-03T02:03:01.306314197Z [2024-04-03T02:03:01.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:02:00+00:00 exited with status queued for try_number 1 2024-04-03T02:03:01.314404816Z [2024-04-03T02:03:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8be56e7-f797-410d-b8d0-964a30ae7bd4 2024-04-03T02:03:01.314698601Z [2024-04-03T02:03:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95751f65-40bc-436f-9e51-4f9603ab0721 2024-04-03T02:03:04.900502987Z [2024-04-03T02:03:04.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:03:04.914797099Z [2024-04-03T02:03:04.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:02:00+00:00, run_id=scheduled__2024-04-03T02:02:00+00:00, run_start_date=2024-04-03 02:03:01.044136+00:00, run_end_date=2024-04-03 02:03:04.900591+00:00, run_duration=3.856455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:02:00+00:00, data_interval_end=2024-04-03 02:03:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:03:04.922894900Z [2024-04-03T02:03:04.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:03:00+00:00, run_after=2024-04-03T02:04:00+00:00 2024-04-03T02:03:04.963467438Z [2024-04-03T02:03:04.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:02:00+00:00 exited with status success for try_number 1 2024-04-03T02:03:04.969894458Z [2024-04-03T02:03:04.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:02:00+00:00, map_index=-1, run_start_date=2024-04-03 02:03:03.007424+00:00, run_end_date=2024-04-03 02:03:04.730557+00:00, run_duration=1.723133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:03:01.084188+00:00, queued_by_job_id=1, pid=3006 2024-04-03T02:03:06.037621407Z [2024-04-03T02:03:06.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:03:06.038260437Z [2024-04-03T02:03:06.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:02:00+00:00, run_id=scheduled__2024-04-03T02:02:00+00:00, run_start_date=2024-04-03 02:03:01.045778+00:00, run_end_date=2024-04-03 02:03:06.037509+00:00, run_duration=4.991731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:02:00+00:00, data_interval_end=2024-04-03 02:03:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:03:06.055526672Z [2024-04-03T02:03:06.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:03:00+00:00, run_after=2024-04-03T02:04:00+00:00 2024-04-03T02:03:06.098599450Z [2024-04-03T02:03:06.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:02:00+00:00 exited with status success for try_number 1 2024-04-03T02:03:06.105390649Z [2024-04-03T02:03:06.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:02:00+00:00, map_index=-1, run_start_date=2024-04-03 02:03:03.444247+00:00, run_end_date=2024-04-03 02:03:05.840400+00:00, run_duration=2.396153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:03:01.084188+00:00, queued_by_job_id=1, pid=3025 2024-04-03T02:04:00.283913589Z [2024-04-03T02:04:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:04:00+00:00, run_after=2024-04-03T02:05:00+00:00 2024-04-03T02:04:00.291117130Z [2024-04-03T02:04:00.290+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:04:00.298445003Z [2024-04-03T02:04:00.298+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:04:00.359171614Z [2024-04-03T02:04:00.358+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:04:00.359198671Z 2024-04-03T02:04:00.359202925Z 2024-04-03T02:04:00.359210321Z 2024-04-03T02:04:00.359500313Z [2024-04-03T02:04:00.359+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:04:00.359555572Z [2024-04-03T02:04:00.359+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:04:00.359637926Z [2024-04-03T02:04:00.359+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:04:00.360059230Z [2024-04-03T02:04:00.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:04:00.360070977Z 2024-04-03T02:04:00.360074858Z 2024-04-03T02:04:00.360078502Z 2024-04-03T02:04:00.363680240Z [2024-04-03T02:04:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:04:00.363941799Z [2024-04-03T02:04:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:04:00.364080699Z [2024-04-03T02:04:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:04:00.364238343Z [2024-04-03T02:04:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:04:00.364548384Z [2024-04-03T02:04:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:04:00.364767958Z [2024-04-03T02:04:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:04:00.811361975Z [2024-04-03T02:04:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:02:00+00:00 exited with status queued for try_number 1 2024-04-03T02:04:00.811562387Z [2024-04-03T02:04:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:03:00+00:00 exited with status queued for try_number 1 2024-04-03T02:04:00.811571820Z [2024-04-03T02:04:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:03:00+00:00 exited with status queued for try_number 1 2024-04-03T02:04:00.827880346Z [2024-04-03T02:04:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to aefe131a-a225-48a9-a2c4-ecea7dd1cfe0 2024-04-03T02:04:00.827967824Z [2024-04-03T02:04:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83141179-bd44-482b-b3c2-34f5ffdb0ecb 2024-04-03T02:04:00.828013965Z [2024-04-03T02:04:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f7dcb0b-2cef-482a-9a3e-78535efad7db 2024-04-03T02:04:02.806735408Z [2024-04-03T02:04:02.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:04:02.806767880Z [2024-04-03T02:04:02.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:02:00+00:00, run_id=scheduled__2024-04-03T02:02:00+00:00, run_start_date=2024-04-03 02:04:00.308245+00:00, run_end_date=2024-04-03 02:04:02.800903+00:00, run_duration=2.492658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:02:00+00:00, data_interval_end=2024-04-03 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:04:02.814729195Z [2024-04-03T02:04:02.813+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:04:00+00:00, run_after=2024-04-03T02:06:00+00:00 2024-04-03T02:04:02.900613031Z [2024-04-03T02:04:02.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:02:00+00:00 exited with status success for try_number 1 2024-04-03T02:04:02.906858845Z [2024-04-03T02:04:02.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:02:00+00:00, map_index=-1, run_start_date=2024-04-03 02:04:01.777496+00:00, run_end_date=2024-04-03 02:04:02.538947+00:00, run_duration=0.761451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:04:00.360815+00:00, queued_by_job_id=1, pid=3050 2024-04-03T02:04:06.819915890Z [2024-04-03T02:04:06.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:04:06.820220612Z [2024-04-03T02:04:06.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:03:00+00:00, run_id=scheduled__2024-04-03T02:03:00+00:00, run_start_date=2024-04-03 02:04:00.310678+00:00, run_end_date=2024-04-03 02:04:06.819813+00:00, run_duration=6.509135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:03:00+00:00, data_interval_end=2024-04-03 02:04:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:04:06.829832326Z [2024-04-03T02:04:06.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:04:00+00:00, run_after=2024-04-03T02:05:00+00:00 2024-04-03T02:04:06.868004254Z [2024-04-03T02:04:06.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:03:00+00:00 exited with status success for try_number 1 2024-04-03T02:04:06.873178579Z [2024-04-03T02:04:06.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:03:00+00:00, map_index=-1, run_start_date=2024-04-03 02:04:03.666164+00:00, run_end_date=2024-04-03 02:04:06.573838+00:00, run_duration=2.907674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:04:00.360815+00:00, queued_by_job_id=1, pid=3071 2024-04-03T02:04:07.927350874Z [2024-04-03T02:04:07.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:04:07.927792185Z [2024-04-03T02:04:07.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:03:00+00:00, run_id=scheduled__2024-04-03T02:03:00+00:00, run_start_date=2024-04-03 02:04:00.309595+00:00, run_end_date=2024-04-03 02:04:07.927175+00:00, run_duration=7.61758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:03:00+00:00, data_interval_end=2024-04-03 02:04:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:04:07.938493307Z [2024-04-03T02:04:07.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:04:00+00:00, run_after=2024-04-03T02:05:00+00:00 2024-04-03T02:04:07.978178998Z [2024-04-03T02:04:07.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:03:00+00:00 exited with status success for try_number 1 2024-04-03T02:04:07.985380783Z [2024-04-03T02:04:07.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:03:00+00:00, map_index=-1, run_start_date=2024-04-03 02:04:04.342203+00:00, run_end_date=2024-04-03 02:04:06.953577+00:00, run_duration=2.611374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:04:00.360815+00:00, queued_by_job_id=1, pid=3090 2024-04-03T02:05:00.419144929Z [2024-04-03T02:05:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:05:00+00:00, run_after=2024-04-03T02:06:00+00:00 2024-04-03T02:05:00.425818986Z [2024-04-03T02:05:00.425+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:05:00.449432607Z [2024-04-03T02:05:00.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:05:00+00:00, run_after=2024-04-03T02:10:00+00:00 2024-04-03T02:05:00.523205164Z [2024-04-03T02:05:00.522+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:05:00.523231305Z 2024-04-03T02:05:00.523235493Z 2024-04-03T02:05:00.523238624Z 2024-04-03T02:05:00.523281886Z [2024-04-03T02:05:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:05:00.523289385Z [2024-04-03T02:05:00.523+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:05:00.523340874Z [2024-04-03T02:05:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:05:00.523892380Z [2024-04-03T02:05:00.523+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:05:00.523901122Z 2024-04-03T02:05:00.523911526Z 2024-04-03T02:05:00.523914959Z 2024-04-03T02:05:00.543711249Z [2024-04-03T02:05:00.540+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:05:00.543730532Z [2024-04-03T02:05:00.540+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:05:00.543752299Z [2024-04-03T02:05:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:05:00.543755546Z [2024-04-03T02:05:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:05:00.543758627Z [2024-04-03T02:05:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:05:00.543761613Z [2024-04-03T02:05:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:05:00.932846755Z [2024-04-03T02:05:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status queued for try_number 1 2024-04-03T02:05:00.933480178Z [2024-04-03T02:05:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:04:00+00:00 exited with status queued for try_number 1 2024-04-03T02:05:00.933698095Z [2024-04-03T02:05:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:04:00+00:00 exited with status queued for try_number 1 2024-04-03T02:05:00.948765705Z [2024-04-03T02:05:00.948+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0af80cf9-e23d-4170-aaf3-0a36100174ef 2024-04-03T02:05:00.948984956Z [2024-04-03T02:05:00.948+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0da6edf1-cc84-464b-abb4-f2370bd05623 2024-04-03T02:05:00.951643248Z [2024-04-03T02:05:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe362b74-a74b-49f6-943a-91fafc3181dd 2024-04-03T02:05:04.482277122Z [2024-04-03T02:05:04.481+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:05:04.482333882Z 2024-04-03T02:05:04.482343644Z [2024-04-03T02:05:04.481+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:05:04.482878292Z [2024-04-03T02:05:04.482+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:05:04.483018278Z 2024-04-03T02:05:04.485929106Z [2024-04-03T02:05:04.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:05:04.485989213Z [2024-04-03T02:05:04.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:05:04.550904150Z [2024-04-03T02:05:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status queued for try_number 1 2024-04-03T02:05:04.550947762Z [2024-04-03T02:05:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status success for try_number 1 2024-04-03T02:05:04.564398580Z [2024-04-03T02:05:04.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4854dc93-c538-4c06-8ce4-1c8c29ebc33d 2024-04-03T02:05:04.564834617Z [2024-04-03T02:05:04.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:00:00+00:00, map_index=-1, run_start_date=2024-04-03 02:05:03.276314+00:00, run_end_date=2024-04-03 02:05:03.855712+00:00, run_duration=0.579398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:05:00.524469+00:00, queued_by_job_id=1, pid=3157 2024-04-03T02:05:05.693760716Z [2024-04-03T02:05:05.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:05:05.693945823Z [2024-04-03T02:05:05.693+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:04:00+00:00, run_id=scheduled__2024-04-03T02:04:00+00:00, run_start_date=2024-04-03 02:05:00.464018+00:00, run_end_date=2024-04-03 02:05:05.693625+00:00, run_duration=5.229607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:04:00+00:00, data_interval_end=2024-04-03 02:05:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:05:05.704597258Z [2024-04-03T02:05:05.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:05:00+00:00, run_after=2024-04-03T02:06:00+00:00 2024-04-03T02:05:05.711086544Z [2024-04-03T02:05:05.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:05:05.711221375Z [2024-04-03T02:05:05.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:04:00+00:00, run_id=scheduled__2024-04-03T02:04:00+00:00, run_start_date=2024-04-03 02:05:00.465197+00:00, run_end_date=2024-04-03 02:05:05.711005+00:00, run_duration=5.245808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:04:00+00:00, data_interval_end=2024-04-03 02:05:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:05:05.720405546Z [2024-04-03T02:05:05.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:05:00+00:00, run_after=2024-04-03T02:06:00+00:00 2024-04-03T02:05:05.769700141Z [2024-04-03T02:05:05.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:04:00+00:00 exited with status success for try_number 1 2024-04-03T02:05:05.769821201Z [2024-04-03T02:05:05.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:04:00+00:00 exited with status success for try_number 1 2024-04-03T02:05:05.785526234Z [2024-04-03T02:05:05.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:04:00+00:00, map_index=-1, run_start_date=2024-04-03 02:05:03.102075+00:00, run_end_date=2024-04-03 02:05:04.847660+00:00, run_duration=1.745585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:05:00.524469+00:00, queued_by_job_id=1, pid=3147 2024-04-03T02:05:05.785727482Z [2024-04-03T02:05:05.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:04:00+00:00, map_index=-1, run_start_date=2024-04-03 02:05:02.785743+00:00, run_end_date=2024-04-03 02:05:05.184223+00:00, run_duration=2.39848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:05:00.524469+00:00, queued_by_job_id=1, pid=3134 2024-04-03T02:05:07.145695006Z [2024-04-03T02:05:07.145+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:05:07.145718840Z 2024-04-03T02:05:07.145737403Z [2024-04-03T02:05:07.145+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:05:07.146583618Z [2024-04-03T02:05:07.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:05:07.146629777Z 2024-04-03T02:05:07.149457294Z [2024-04-03T02:05:07.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:05:07.149897705Z [2024-04-03T02:05:07.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:05:07.199777818Z [2024-04-03T02:05:07.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status queued for try_number 1 2024-04-03T02:05:07.199840704Z [2024-04-03T02:05:07.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status success for try_number 1 2024-04-03T02:05:07.210502427Z [2024-04-03T02:05:07.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 608f7513-d6b1-4ae1-b7d7-f2f768bc52e7 2024-04-03T02:05:07.211006360Z [2024-04-03T02:05:07.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:00:00+00:00, map_index=-1, run_start_date=2024-04-03 02:05:06.073889+00:00, run_end_date=2024-04-03 02:05:06.404627+00:00, run_duration=0.330738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:05:04.483088+00:00, queued_by_job_id=1, pid=3187 2024-04-03T02:05:09.471386439Z [2024-04-03T02:05:09.470+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:05:09.471450916Z 2024-04-03T02:05:09.471674711Z [2024-04-03T02:05:09.471+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:05:09.472482776Z [2024-04-03T02:05:09.472+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:05:09.472519997Z 2024-04-03T02:05:09.475651122Z [2024-04-03T02:05:09.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:05:09.475932823Z [2024-04-03T02:05:09.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:05:09.536308845Z [2024-04-03T02:05:09.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status queued for try_number 1 2024-04-03T02:05:09.536645655Z [2024-04-03T02:05:09.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status success for try_number 1 2024-04-03T02:05:09.543868983Z [2024-04-03T02:05:09.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bfc16e7-0058-4102-87f3-221869b305b0 2024-04-03T02:05:09.544156397Z [2024-04-03T02:05:09.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:00:00+00:00, map_index=0, run_start_date=2024-04-03 02:05:08.829978+00:00, run_end_date=2024-04-03 02:05:09.171093+00:00, run_duration=0.341115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:05:07.147045+00:00, queued_by_job_id=1, pid=3199 2024-04-03T02:05:12.198321922Z [2024-04-03T02:05:12.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:05:12.199055293Z [2024-04-03T02:05:12.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:00:00+00:00, run_id=scheduled__2024-04-03T02:00:00+00:00, run_start_date=2024-04-03 02:05:00.461789+00:00, run_end_date=2024-04-03 02:05:12.198235+00:00, run_duration=11.736446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:00:00+00:00, data_interval_end=2024-04-03 02:05:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:05:12.204980855Z [2024-04-03T02:05:12.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:05:00+00:00, run_after=2024-04-03T02:10:00+00:00 2024-04-03T02:05:12.234712592Z [2024-04-03T02:05:12.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:00:00+00:00 exited with status success for try_number 1 2024-04-03T02:05:12.240470486Z [2024-04-03T02:05:12.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:00:00+00:00, map_index=-1, run_start_date=2024-04-03 02:05:11.499179+00:00, run_end_date=2024-04-03 02:05:11.913215+00:00, run_duration=0.414036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:05:09.473011+00:00, queued_by_job_id=1, pid=3211 2024-04-03T02:06:01.048844386Z [2024-04-03T02:06:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:06:00+00:00, run_after=2024-04-03T02:07:00+00:00 2024-04-03T02:06:01.055978621Z [2024-04-03T02:06:01.055+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:06:01.062319966Z [2024-04-03T02:06:01.061+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:06:01.125769373Z [2024-04-03T02:06:01.125+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:06:01.125792562Z 2024-04-03T02:06:01.125796640Z 2024-04-03T02:06:01.125799846Z 2024-04-03T02:06:01.126332125Z [2024-04-03T02:06:01.126+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:06:01.126635994Z [2024-04-03T02:06:01.126+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:06:01.126883331Z [2024-04-03T02:06:01.126+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:06:01.127530893Z [2024-04-03T02:06:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:06:01.127541977Z 2024-04-03T02:06:01.127545637Z 2024-04-03T02:06:01.127549018Z 2024-04-03T02:06:01.130714037Z [2024-04-03T02:06:01.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:06:01.130984713Z [2024-04-03T02:06:01.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:06:01.131333486Z [2024-04-03T02:06:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:06:01.131546408Z [2024-04-03T02:06:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:06:01.131876519Z [2024-04-03T02:06:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:06:01.132083655Z [2024-04-03T02:06:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:06:01.425809237Z [2024-04-03T02:06:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:04:00+00:00 exited with status queued for try_number 1 2024-04-03T02:06:01.425983278Z [2024-04-03T02:06:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status queued for try_number 1 2024-04-03T02:06:01.426140335Z [2024-04-03T02:06:01.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status queued for try_number 1 2024-04-03T02:06:01.446491192Z [2024-04-03T02:06:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e39434a-0d7d-451d-8fc8-69138f5d06e0 2024-04-03T02:06:01.446823696Z [2024-04-03T02:06:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50d2281f-71fc-4f95-9879-04c3d23ae024 2024-04-03T02:06:01.447047784Z [2024-04-03T02:06:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84215948-d708-49e0-9773-fc98657bbbc1 2024-04-03T02:06:03.087583053Z [2024-04-03T02:06:03.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:06:03.091732611Z [2024-04-03T02:06:03.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:04:00+00:00, run_id=scheduled__2024-04-03T02:04:00+00:00, run_start_date=2024-04-03 02:06:01.071540+00:00, run_end_date=2024-04-03 02:06:03.089438+00:00, run_duration=2.017898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:04:00+00:00, data_interval_end=2024-04-03 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:06:03.101693368Z [2024-04-03T02:06:03.101+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:06:00+00:00, run_after=2024-04-03T02:08:00+00:00 2024-04-03T02:06:03.243719452Z [2024-04-03T02:06:03.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:04:00+00:00 exited with status success for try_number 1 2024-04-03T02:06:03.259651040Z [2024-04-03T02:06:03.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:04:00+00:00, map_index=-1, run_start_date=2024-04-03 02:06:01.974052+00:00, run_end_date=2024-04-03 02:06:02.326376+00:00, run_duration=0.352324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:06:01.128327+00:00, queued_by_job_id=1, pid=3228 2024-04-03T02:06:05.922621325Z [2024-04-03T02:06:05.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:06:05.922898704Z [2024-04-03T02:06:05.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:05:00+00:00, run_id=scheduled__2024-04-03T02:05:00+00:00, run_start_date=2024-04-03 02:06:01.072694+00:00, run_end_date=2024-04-03 02:06:05.922350+00:00, run_duration=4.849656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:05:00+00:00, data_interval_end=2024-04-03 02:06:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:06:05.933877321Z [2024-04-03T02:06:05.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:06:00+00:00, run_after=2024-04-03T02:07:00+00:00 2024-04-03T02:06:05.969047859Z [2024-04-03T02:06:05.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status success for try_number 1 2024-04-03T02:06:05.977941876Z [2024-04-03T02:06:05.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:05:00+00:00, map_index=-1, run_start_date=2024-04-03 02:06:03.074088+00:00, run_end_date=2024-04-03 02:06:05.029935+00:00, run_duration=1.955847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:06:01.128327+00:00, queued_by_job_id=1, pid=3258 2024-04-03T02:06:07.014380500Z [2024-04-03T02:06:07.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:06:07.014483874Z [2024-04-03T02:06:07.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:05:00+00:00, run_id=scheduled__2024-04-03T02:05:00+00:00, run_start_date=2024-04-03 02:06:01.073764+00:00, run_end_date=2024-04-03 02:06:07.014113+00:00, run_duration=5.940349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:05:00+00:00, data_interval_end=2024-04-03 02:06:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:06:07.023225691Z [2024-04-03T02:06:07.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:06:00+00:00, run_after=2024-04-03T02:07:00+00:00 2024-04-03T02:06:07.050243138Z [2024-04-03T02:06:07.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status success for try_number 1 2024-04-03T02:06:07.055150867Z [2024-04-03T02:06:07.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:05:00+00:00, map_index=-1, run_start_date=2024-04-03 02:06:03.145369+00:00, run_end_date=2024-04-03 02:06:06.202751+00:00, run_duration=3.057382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:06:01.128327+00:00, queued_by_job_id=1, pid=3259 2024-04-03T02:06:35.191639744Z [2024-04-03T02:06:35.190+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:07:00.954028318Z [2024-04-03T02:07:00.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:07:00+00:00, run_after=2024-04-03T02:08:00+00:00 2024-04-03T02:07:00.961524055Z [2024-04-03T02:07:00.961+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:07:01.030394301Z [2024-04-03T02:07:01.030+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:07:01.030425357Z 2024-04-03T02:07:01.030429155Z 2024-04-03T02:07:01.030734512Z [2024-04-03T02:07:01.030+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:07:01.030907547Z [2024-04-03T02:07:01.030+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:07:01.031573697Z [2024-04-03T02:07:01.031+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:07:01.031586144Z 2024-04-03T02:07:01.031589834Z 2024-04-03T02:07:01.035076293Z [2024-04-03T02:07:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:07:01.035434579Z [2024-04-03T02:07:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:07:01.035906300Z [2024-04-03T02:07:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:07:01.036150907Z [2024-04-03T02:07:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:07:01.213978999Z [2024-04-03T02:07:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:06:00+00:00 exited with status queued for try_number 1 2024-04-03T02:07:01.214013321Z [2024-04-03T02:07:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:06:00+00:00 exited with status queued for try_number 1 2024-04-03T02:07:01.225147210Z [2024-04-03T02:07:01.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34afedde-f4f3-4aaa-96e5-acd5301555ba 2024-04-03T02:07:01.225707949Z [2024-04-03T02:07:01.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8efc838-6914-44cd-8cba-a36810c82348 2024-04-03T02:07:06.331603386Z [2024-04-03T02:07:06.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:07:06.332492062Z [2024-04-03T02:07:06.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:06:00+00:00, run_id=scheduled__2024-04-03T02:06:00+00:00, run_start_date=2024-04-03 02:07:00.975690+00:00, run_end_date=2024-04-03 02:07:06.332033+00:00, run_duration=5.356343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:06:00+00:00, data_interval_end=2024-04-03 02:07:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:07:06.344007080Z [2024-04-03T02:07:06.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:07:00+00:00, run_after=2024-04-03T02:08:00+00:00 2024-04-03T02:07:06.354630965Z [2024-04-03T02:07:06.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:07:06.355006114Z [2024-04-03T02:07:06.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:06:00+00:00, run_id=scheduled__2024-04-03T02:06:00+00:00, run_start_date=2024-04-03 02:07:00.973519+00:00, run_end_date=2024-04-03 02:07:06.354695+00:00, run_duration=5.381176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:06:00+00:00, data_interval_end=2024-04-03 02:07:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:07:06.368876460Z [2024-04-03T02:07:06.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:07:00+00:00, run_after=2024-04-03T02:08:00+00:00 2024-04-03T02:07:06.397481277Z [2024-04-03T02:07:06.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:06:00+00:00 exited with status success for try_number 1 2024-04-03T02:07:06.397529439Z [2024-04-03T02:07:06.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:06:00+00:00 exited with status success for try_number 1 2024-04-03T02:07:06.404235074Z [2024-04-03T02:07:06.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:06:00+00:00, map_index=-1, run_start_date=2024-04-03 02:07:02.956970+00:00, run_end_date=2024-04-03 02:07:05.181995+00:00, run_duration=2.225025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:07:01.032381+00:00, queued_by_job_id=1, pid=3313 2024-04-03T02:07:06.404371129Z [2024-04-03T02:07:06.404+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:06:00+00:00, map_index=-1, run_start_date=2024-04-03 02:07:03.025338+00:00, run_end_date=2024-04-03 02:07:05.202501+00:00, run_duration=2.177163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:07:01.032381+00:00, queued_by_job_id=1, pid=3314 2024-04-03T02:08:00.815264489Z [2024-04-03T02:08:00.813+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:08:00.828651134Z [2024-04-03T02:08:00.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:08:00+00:00, run_after=2024-04-03T02:09:00+00:00 2024-04-03T02:08:00.836399127Z [2024-04-03T02:08:00.835+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:08:00.914947534Z [2024-04-03T02:08:00.914+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:08:00.914993895Z 2024-04-03T02:08:00.914998494Z 2024-04-03T02:08:00.915002104Z 2024-04-03T02:08:00.915094282Z [2024-04-03T02:08:00.914+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:08:00.915320130Z [2024-04-03T02:08:00.915+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:08:00.915485171Z [2024-04-03T02:08:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:08:00.916112073Z [2024-04-03T02:08:00.915+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:08:00.916124873Z 2024-04-03T02:08:00.916128454Z 2024-04-03T02:08:00.916141370Z 2024-04-03T02:08:00.920724710Z [2024-04-03T02:08:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:08:00.921028431Z [2024-04-03T02:08:00.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:08:00.921414659Z [2024-04-03T02:08:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:08:00.921623176Z [2024-04-03T02:08:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:08:00.921922215Z [2024-04-03T02:08:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:08:00.922109805Z [2024-04-03T02:08:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:08:01.216751277Z [2024-04-03T02:08:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:06:00+00:00 exited with status queued for try_number 1 2024-04-03T02:08:01.216902215Z [2024-04-03T02:08:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:07:00+00:00 exited with status queued for try_number 1 2024-04-03T02:08:01.217131953Z [2024-04-03T02:08:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:07:00+00:00 exited with status queued for try_number 1 2024-04-03T02:08:01.230630738Z [2024-04-03T02:08:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to b53cd7b8-f9a9-4321-86ed-65122ef977ca 2024-04-03T02:08:01.230730217Z [2024-04-03T02:08:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to a060e112-0703-47d2-889f-b70aa35995de 2024-04-03T02:08:01.230944186Z [2024-04-03T02:08:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to f95083d0-4d56-4bdc-a987-f7ae7e356916 2024-04-03T02:08:03.144707919Z [2024-04-03T02:08:03.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:08:03.145159611Z [2024-04-03T02:08:03.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:06:00+00:00, run_id=scheduled__2024-04-03T02:06:00+00:00, run_start_date=2024-04-03 02:08:00.848685+00:00, run_end_date=2024-04-03 02:08:03.144693+00:00, run_duration=2.296008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:06:00+00:00, data_interval_end=2024-04-03 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:08:03.158784932Z [2024-04-03T02:08:03.158+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:08:00+00:00, run_after=2024-04-03T02:10:00+00:00 2024-04-03T02:08:03.243725343Z [2024-04-03T02:08:03.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:06:00+00:00 exited with status success for try_number 1 2024-04-03T02:08:03.252701597Z [2024-04-03T02:08:03.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:06:00+00:00, map_index=-1, run_start_date=2024-04-03 02:08:02.010406+00:00, run_end_date=2024-04-03 02:08:02.530847+00:00, run_duration=0.520441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:08:00.916898+00:00, queued_by_job_id=1, pid=3349 2024-04-03T02:08:06.767611590Z [2024-04-03T02:08:06.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:08:06.767730972Z [2024-04-03T02:08:06.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:07:00+00:00, run_id=scheduled__2024-04-03T02:07:00+00:00, run_start_date=2024-04-03 02:08:00.850144+00:00, run_end_date=2024-04-03 02:08:06.767368+00:00, run_duration=5.917224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:07:00+00:00, data_interval_end=2024-04-03 02:08:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:08:06.780485368Z [2024-04-03T02:08:06.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:08:00+00:00, run_after=2024-04-03T02:09:00+00:00 2024-04-03T02:08:06.789185163Z [2024-04-03T02:08:06.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:08:06.789257696Z [2024-04-03T02:08:06.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:07:00+00:00, run_id=scheduled__2024-04-03T02:07:00+00:00, run_start_date=2024-04-03 02:08:00.851231+00:00, run_end_date=2024-04-03 02:08:06.789002+00:00, run_duration=5.937771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:07:00+00:00, data_interval_end=2024-04-03 02:08:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:08:06.800086861Z [2024-04-03T02:08:06.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:08:00+00:00, run_after=2024-04-03T02:09:00+00:00 2024-04-03T02:08:06.834160018Z [2024-04-03T02:08:06.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:07:00+00:00 exited with status success for try_number 1 2024-04-03T02:08:06.834192544Z [2024-04-03T02:08:06.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:07:00+00:00 exited with status success for try_number 1 2024-04-03T02:08:06.843254996Z [2024-04-03T02:08:06.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:07:00+00:00, map_index=-1, run_start_date=2024-04-03 02:08:03.354392+00:00, run_end_date=2024-04-03 02:08:06.274177+00:00, run_duration=2.919785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:08:00.916898+00:00, queued_by_job_id=1, pid=3379 2024-04-03T02:08:06.843342809Z [2024-04-03T02:08:06.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:07:00+00:00, map_index=-1, run_start_date=2024-04-03 02:08:03.415572+00:00, run_end_date=2024-04-03 02:08:06.009040+00:00, run_duration=2.593468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:08:00.916898+00:00, queued_by_job_id=1, pid=3380 2024-04-03T02:09:00.696683066Z [2024-04-03T02:09:00.696+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:09:00.710134830Z [2024-04-03T02:09:00.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:09:00+00:00, run_after=2024-04-03T02:10:00+00:00 2024-04-03T02:09:00.815720132Z [2024-04-03T02:09:00.810+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:09:00.815741226Z 2024-04-03T02:09:00.815745058Z 2024-04-03T02:09:00.815748291Z [2024-04-03T02:09:00.810+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:09:00.815751286Z [2024-04-03T02:09:00.810+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:09:00.815765433Z [2024-04-03T02:09:00.810+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:09:00.815768826Z 2024-04-03T02:09:00.815771882Z 2024-04-03T02:09:00.815778389Z [2024-04-03T02:09:00.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:09:00.815781740Z [2024-04-03T02:09:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:09:00.815784795Z [2024-04-03T02:09:00.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:09:00.815787770Z [2024-04-03T02:09:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:09:01.036933756Z [2024-04-03T02:09:01.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:08:00+00:00 exited with status queued for try_number 1 2024-04-03T02:09:01.037073516Z [2024-04-03T02:09:01.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:08:00+00:00 exited with status queued for try_number 1 2024-04-03T02:09:01.047381399Z [2024-04-03T02:09:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40b4524c-0456-4c3e-a686-94d2e201ebd9 2024-04-03T02:09:01.049427277Z [2024-04-03T02:09:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43d571c6-ef45-4e4c-a707-b7f307406164 2024-04-03T02:09:05.027453850Z [2024-04-03T02:09:05.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:09:05.027953193Z [2024-04-03T02:09:05.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:08:00+00:00, run_id=scheduled__2024-04-03T02:08:00+00:00, run_start_date=2024-04-03 02:09:00.738563+00:00, run_end_date=2024-04-03 02:09:05.027285+00:00, run_duration=4.288722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:08:00+00:00, data_interval_end=2024-04-03 02:09:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:09:05.037567851Z [2024-04-03T02:09:05.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:09:00+00:00, run_after=2024-04-03T02:10:00+00:00 2024-04-03T02:09:05.071686757Z [2024-04-03T02:09:05.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:08:00+00:00 exited with status success for try_number 1 2024-04-03T02:09:05.080483205Z [2024-04-03T02:09:05.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:08:00+00:00, map_index=-1, run_start_date=2024-04-03 02:09:02.801853+00:00, run_end_date=2024-04-03 02:09:04.769244+00:00, run_duration=1.967391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:09:00.811827+00:00, queued_by_job_id=1, pid=3434 2024-04-03T02:09:06.123989882Z [2024-04-03T02:09:06.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:09:06.124470352Z [2024-04-03T02:09:06.124+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:08:00+00:00, run_id=scheduled__2024-04-03T02:08:00+00:00, run_start_date=2024-04-03 02:09:00.735863+00:00, run_end_date=2024-04-03 02:09:06.123792+00:00, run_duration=5.387929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:08:00+00:00, data_interval_end=2024-04-03 02:09:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:09:06.139124001Z [2024-04-03T02:09:06.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:09:00+00:00, run_after=2024-04-03T02:10:00+00:00 2024-04-03T02:09:06.181125288Z [2024-04-03T02:09:06.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:08:00+00:00 exited with status success for try_number 1 2024-04-03T02:09:06.188982051Z [2024-04-03T02:09:06.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:08:00+00:00, map_index=-1, run_start_date=2024-04-03 02:09:02.875706+00:00, run_end_date=2024-04-03 02:09:05.029088+00:00, run_duration=2.153382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:09:00.811827+00:00, queued_by_job_id=1, pid=3435 2024-04-03T02:10:00.537012096Z [2024-04-03T02:10:00.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:10:00+00:00, run_after=2024-04-03T02:11:00+00:00 2024-04-03T02:10:00.550142096Z [2024-04-03T02:10:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:10:00+00:00, run_after=2024-04-03T02:15:00+00:00 2024-04-03T02:10:00.556694114Z [2024-04-03T02:10:00.556+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:10:00.562528182Z [2024-04-03T02:10:00.562+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:10:00.647342297Z [2024-04-03T02:10:00.647+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T02:10:00.647367635Z 2024-04-03T02:10:00.647371275Z 2024-04-03T02:10:00.647375455Z 2024-04-03T02:10:00.647378639Z 2024-04-03T02:10:00.647430247Z [2024-04-03T02:10:00.647+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:10:00.647439097Z [2024-04-03T02:10:00.647+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:10:00.647528049Z [2024-04-03T02:10:00.647+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:10:00.647606979Z [2024-04-03T02:10:00.647+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:10:00.648161486Z [2024-04-03T02:10:00.647+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:10:00.648173740Z 2024-04-03T02:10:00.648177735Z 2024-04-03T02:10:00.648181428Z 2024-04-03T02:10:00.648184873Z 2024-04-03T02:10:00.654265911Z [2024-04-03T02:10:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:10:00.654551179Z [2024-04-03T02:10:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:10:00.654939271Z [2024-04-03T02:10:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:10:00.655203631Z [2024-04-03T02:10:00.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:10:00.655705080Z [2024-04-03T02:10:00.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:10:00.655944997Z [2024-04-03T02:10:00.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:10:00.656293962Z [2024-04-03T02:10:00.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:10:00.656510533Z [2024-04-03T02:10:00.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:10:01.144613943Z [2024-04-03T02:10:01.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status queued for try_number 1 2024-04-03T02:10:01.145290704Z [2024-04-03T02:10:01.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:08:00+00:00 exited with status queued for try_number 1 2024-04-03T02:10:01.146460253Z [2024-04-03T02:10:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:09:00+00:00 exited with status queued for try_number 1 2024-04-03T02:10:01.146649463Z [2024-04-03T02:10:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:09:00+00:00 exited with status queued for try_number 1 2024-04-03T02:10:01.160315242Z [2024-04-03T02:10:01.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd17179d-66d9-4b29-a2fc-a5ebead159f7 2024-04-03T02:10:01.161179586Z [2024-04-03T02:10:01.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to 105acf28-2891-42f4-91a2-d13525a1ba65 2024-04-03T02:10:01.166496508Z [2024-04-03T02:10:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb55f38d-cce8-421b-8500-67d62420038c 2024-04-03T02:10:01.168415980Z [2024-04-03T02:10:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee78e934-4a97-4376-944b-c1f85001e32b 2024-04-03T02:10:03.706693044Z [2024-04-03T02:10:03.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:10:03.707187359Z [2024-04-03T02:10:03.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:08:00+00:00, run_id=scheduled__2024-04-03T02:08:00+00:00, run_start_date=2024-04-03 02:10:00.572345+00:00, run_end_date=2024-04-03 02:10:03.706606+00:00, run_duration=3.134261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:08:00+00:00, data_interval_end=2024-04-03 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:10:03.724663565Z [2024-04-03T02:10:03.724+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:10:00+00:00, run_after=2024-04-03T02:12:00+00:00 2024-04-03T02:10:03.797604317Z [2024-04-03T02:10:03.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:08:00+00:00 exited with status success for try_number 1 2024-04-03T02:10:03.802841554Z [2024-04-03T02:10:03.802+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:08:00+00:00, map_index=-1, run_start_date=2024-04-03 02:10:02.133030+00:00, run_end_date=2024-04-03 02:10:02.727301+00:00, run_duration=0.594271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:10:00.648903+00:00, queued_by_job_id=1, pid=3473 2024-04-03T02:10:04.838569749Z [2024-04-03T02:10:04.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:10:04.838783994Z [2024-04-03T02:10:04.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:09:00+00:00, run_id=scheduled__2024-04-03T02:09:00+00:00, run_start_date=2024-04-03 02:10:00.573421+00:00, run_end_date=2024-04-03 02:10:04.838464+00:00, run_duration=4.265043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:09:00+00:00, data_interval_end=2024-04-03 02:10:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:10:04.850234587Z [2024-04-03T02:10:04.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:10:00+00:00, run_after=2024-04-03T02:11:00+00:00 2024-04-03T02:10:04.892119373Z [2024-04-03T02:10:04.891+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:10:04.892147472Z 2024-04-03T02:10:04.892631376Z [2024-04-03T02:10:04.892+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:10:04.893493620Z [2024-04-03T02:10:04.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:10:04.893507422Z 2024-04-03T02:10:04.897212663Z [2024-04-03T02:10:04.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:10:04.897551663Z [2024-04-03T02:10:04.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:10:04.949204889Z [2024-04-03T02:10:04.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status queued for try_number 1 2024-04-03T02:10:04.949281932Z [2024-04-03T02:10:04.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status success for try_number 1 2024-04-03T02:10:04.949415256Z [2024-04-03T02:10:04.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:09:00+00:00 exited with status success for try_number 1 2024-04-03T02:10:04.962406512Z [2024-04-03T02:10:04.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:09:00+00:00, map_index=-1, run_start_date=2024-04-03 02:10:02.928071+00:00, run_end_date=2024-04-03 02:10:04.253652+00:00, run_duration=1.325581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:10:00.648903+00:00, queued_by_job_id=1, pid=3492 2024-04-03T02:10:04.962647117Z [2024-04-03T02:10:04.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cbe47bb-39d0-4453-a938-f59ce6079456 2024-04-03T02:10:04.962806094Z [2024-04-03T02:10:04.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:05:00+00:00, map_index=-1, run_start_date=2024-04-03 02:10:04.052401+00:00, run_end_date=2024-04-03 02:10:04.544813+00:00, run_duration=0.492412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:10:00.648903+00:00, queued_by_job_id=1, pid=3522 2024-04-03T02:10:06.274975707Z [2024-04-03T02:10:06.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:10:06.275202731Z [2024-04-03T02:10:06.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:09:00+00:00, run_id=scheduled__2024-04-03T02:09:00+00:00, run_start_date=2024-04-03 02:10:00.574474+00:00, run_end_date=2024-04-03 02:10:06.274956+00:00, run_duration=5.700482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:09:00+00:00, data_interval_end=2024-04-03 02:10:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:10:06.284854262Z [2024-04-03T02:10:06.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:10:00+00:00, run_after=2024-04-03T02:11:00+00:00 2024-04-03T02:10:07.408354580Z [2024-04-03T02:10:07.407+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:10:07.408394560Z 2024-04-03T02:10:07.408562999Z [2024-04-03T02:10:07.408+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:10:07.409220996Z [2024-04-03T02:10:07.408+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:10:07.409253954Z 2024-04-03T02:10:07.411733449Z [2024-04-03T02:10:07.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:10:07.411891987Z [2024-04-03T02:10:07.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:10:07.464273930Z [2024-04-03T02:10:07.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status queued for try_number 1 2024-04-03T02:10:07.464634609Z [2024-04-03T02:10:07.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:09:00+00:00 exited with status success for try_number 1 2024-04-03T02:10:07.464742369Z [2024-04-03T02:10:07.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status success for try_number 1 2024-04-03T02:10:07.471570995Z [2024-04-03T02:10:07.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:09:00+00:00, map_index=-1, run_start_date=2024-04-03 02:10:04.127394+00:00, run_end_date=2024-04-03 02:10:06.207944+00:00, run_duration=2.08055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:10:00.648903+00:00, queued_by_job_id=1, pid=3523 2024-04-03T02:10:07.471998861Z [2024-04-03T02:10:07.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:05:00+00:00, map_index=-1, run_start_date=2024-04-03 02:10:06.528940+00:00, run_end_date=2024-04-03 02:10:06.884795+00:00, run_duration=0.355855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:10:04.894081+00:00, queued_by_job_id=1, pid=3553 2024-04-03T02:10:07.472222257Z [2024-04-03T02:10:07.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9f69aa3-6721-4731-9f3f-2869c0546f43 2024-04-03T02:10:09.720091197Z [2024-04-03T02:10:09.719+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:10:09.720160107Z 2024-04-03T02:10:09.720211420Z [2024-04-03T02:10:09.719+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:10:09.721365733Z [2024-04-03T02:10:09.721+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:10:09.721390075Z 2024-04-03T02:10:09.723848590Z [2024-04-03T02:10:09.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:10:09.723998188Z [2024-04-03T02:10:09.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:10:09.826665456Z [2024-04-03T02:10:09.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status queued for try_number 1 2024-04-03T02:10:09.826688738Z [2024-04-03T02:10:09.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status success for try_number 1 2024-04-03T02:10:09.829973248Z [2024-04-03T02:10:09.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fd9a9a7-ef5d-4e23-9bba-15bd0218cb04 2024-04-03T02:10:09.829994447Z [2024-04-03T02:10:09.827+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:05:00+00:00, map_index=0, run_start_date=2024-04-03 02:10:09.144255+00:00, run_end_date=2024-04-03 02:10:09.425075+00:00, run_duration=0.28082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:10:07.409575+00:00, queued_by_job_id=1, pid=3565 2024-04-03T02:10:12.485430074Z [2024-04-03T02:10:12.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:10:12.485966531Z [2024-04-03T02:10:12.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:05:00+00:00, run_id=scheduled__2024-04-03T02:05:00+00:00, run_start_date=2024-04-03 02:10:00.571076+00:00, run_end_date=2024-04-03 02:10:12.485514+00:00, run_duration=11.914438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:05:00+00:00, data_interval_end=2024-04-03 02:10:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:10:12.495621138Z [2024-04-03T02:10:12.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:10:00+00:00, run_after=2024-04-03T02:15:00+00:00 2024-04-03T02:10:12.534703098Z [2024-04-03T02:10:12.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:05:00+00:00 exited with status success for try_number 1 2024-04-03T02:10:12.542487097Z [2024-04-03T02:10:12.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:05:00+00:00, map_index=-1, run_start_date=2024-04-03 02:10:11.687705+00:00, run_end_date=2024-04-03 02:10:12.041939+00:00, run_duration=0.354234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:10:09.721881+00:00, queued_by_job_id=1, pid=3577 2024-04-03T02:11:00.226464214Z [2024-04-03T02:11:00.225+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:11:00.240428855Z [2024-04-03T02:11:00.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:11:00+00:00, run_after=2024-04-03T02:12:00+00:00 2024-04-03T02:11:00.321462107Z [2024-04-03T02:11:00.320+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:11:00.321490896Z 2024-04-03T02:11:00.321494914Z 2024-04-03T02:11:00.321838091Z [2024-04-03T02:11:00.321+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:11:00.322232782Z [2024-04-03T02:11:00.321+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:11:00.323318683Z [2024-04-03T02:11:00.323+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:11:00.323341983Z 2024-04-03T02:11:00.323346387Z 2024-04-03T02:11:00.327279449Z [2024-04-03T02:11:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:11:00.327535731Z [2024-04-03T02:11:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:11:00.327865272Z [2024-04-03T02:11:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:11:00.328019310Z [2024-04-03T02:11:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:11:00.663333560Z [2024-04-03T02:11:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status queued for try_number 1 2024-04-03T02:11:00.663385321Z [2024-04-03T02:11:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status queued for try_number 1 2024-04-03T02:11:00.674710215Z [2024-04-03T02:11:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4f4c2a6-dcc2-4ca4-b5b1-7577d000f9f4 2024-04-03T02:11:00.674893954Z [2024-04-03T02:11:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to df71f3a1-44c5-405c-a240-392ee55cdbe7 2024-04-03T02:11:05.152658483Z [2024-04-03T02:11:05.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:11:05.153017900Z [2024-04-03T02:11:05.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:10:00+00:00, run_id=scheduled__2024-04-03T02:10:00+00:00, run_start_date=2024-04-03 02:11:00.254939+00:00, run_end_date=2024-04-03 02:11:05.152439+00:00, run_duration=4.8975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:10:00+00:00, data_interval_end=2024-04-03 02:11:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:11:05.165112827Z [2024-04-03T02:11:05.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:11:00+00:00, run_after=2024-04-03T02:12:00+00:00 2024-04-03T02:11:05.219655626Z [2024-04-03T02:11:05.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status success for try_number 1 2024-04-03T02:11:05.236321323Z [2024-04-03T02:11:05.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:10:00+00:00, map_index=-1, run_start_date=2024-04-03 02:11:02.504023+00:00, run_end_date=2024-04-03 02:11:04.320688+00:00, run_duration=1.816665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:11:00.324447+00:00, queued_by_job_id=1, pid=3615 2024-04-03T02:11:05.798474153Z [2024-04-03T02:11:05.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:11:05.798822035Z [2024-04-03T02:11:05.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:10:00+00:00, run_id=scheduled__2024-04-03T02:10:00+00:00, run_start_date=2024-04-03 02:11:00.257401+00:00, run_end_date=2024-04-03 02:11:05.798379+00:00, run_duration=5.540978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:10:00+00:00, data_interval_end=2024-04-03 02:11:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:11:05.807726583Z [2024-04-03T02:11:05.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:11:00+00:00, run_after=2024-04-03T02:12:00+00:00 2024-04-03T02:11:05.850077951Z [2024-04-03T02:11:05.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status success for try_number 1 2024-04-03T02:11:05.859528330Z [2024-04-03T02:11:05.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:10:00+00:00, map_index=-1, run_start_date=2024-04-03 02:11:02.426575+00:00, run_end_date=2024-04-03 02:11:05.260041+00:00, run_duration=2.833466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:11:00.324447+00:00, queued_by_job_id=1, pid=3614 2024-04-03T02:11:35.233031884Z [2024-04-03T02:11:35.232+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:12:00.053753464Z [2024-04-03T02:12:00.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:12:00+00:00, run_after=2024-04-03T02:13:00+00:00 2024-04-03T02:12:00.061578096Z [2024-04-03T02:12:00.061+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:12:00.068026793Z [2024-04-03T02:12:00.067+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:12:00.133327865Z [2024-04-03T02:12:00.132+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:12:00.133347584Z 2024-04-03T02:12:00.133351645Z 2024-04-03T02:12:00.133355056Z 2024-04-03T02:12:00.133709471Z [2024-04-03T02:12:00.133+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:12:00.133872784Z [2024-04-03T02:12:00.133+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:12:00.134025196Z [2024-04-03T02:12:00.133+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:12:00.134708637Z [2024-04-03T02:12:00.134+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:12:00.134719585Z 2024-04-03T02:12:00.134722904Z 2024-04-03T02:12:00.134726149Z 2024-04-03T02:12:00.139454950Z [2024-04-03T02:12:00.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:12:00.139721572Z [2024-04-03T02:12:00.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:12:00.140289807Z [2024-04-03T02:12:00.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:12:00.140626746Z [2024-04-03T02:12:00.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:12:00.141003076Z [2024-04-03T02:12:00.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:12:00.141436100Z [2024-04-03T02:12:00.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:12:00.531871989Z [2024-04-03T02:12:00.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status queued for try_number 1 2024-04-03T02:12:00.532049811Z [2024-04-03T02:12:00.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:11:00+00:00 exited with status queued for try_number 1 2024-04-03T02:12:00.532195274Z [2024-04-03T02:12:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:11:00+00:00 exited with status queued for try_number 1 2024-04-03T02:12:00.539877367Z [2024-04-03T02:12:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 390c1b93-f6cb-4186-9db3-d9e43c455f35 2024-04-03T02:12:00.540130884Z [2024-04-03T02:12:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to b75fe4b1-f6f4-4370-ab2d-e725c6b4bdff 2024-04-03T02:12:00.540232673Z [2024-04-03T02:12:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d935d7f-faa9-4a2b-b3d9-2e2da4ff58ce 2024-04-03T02:12:01.731795515Z [2024-04-03T02:12:01.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:12:01.731967106Z [2024-04-03T02:12:01.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:10:00+00:00, run_id=scheduled__2024-04-03T02:10:00+00:00, run_start_date=2024-04-03 02:12:00.080973+00:00, run_end_date=2024-04-03 02:12:01.731690+00:00, run_duration=1.650717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:10:00+00:00, data_interval_end=2024-04-03 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:12:01.742557847Z [2024-04-03T02:12:01.742+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:12:00+00:00, run_after=2024-04-03T02:14:00+00:00 2024-04-03T02:12:02.982752354Z [2024-04-03T02:12:02.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status success for try_number 1 2024-04-03T02:12:02.994072108Z [2024-04-03T02:12:02.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:10:00+00:00, map_index=-1, run_start_date=2024-04-03 02:12:01.203659+00:00, run_end_date=2024-04-03 02:12:01.706062+00:00, run_duration=0.502403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:12:00.135525+00:00, queued_by_job_id=1, pid=3650 2024-04-03T02:12:05.498642770Z [2024-04-03T02:12:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:12:05.499064122Z [2024-04-03T02:12:05.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:11:00+00:00, run_id=scheduled__2024-04-03T02:11:00+00:00, run_start_date=2024-04-03 02:12:00.082244+00:00, run_end_date=2024-04-03 02:12:05.498584+00:00, run_duration=5.41634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:11:00+00:00, data_interval_end=2024-04-03 02:12:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:12:05.512639697Z [2024-04-03T02:12:05.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:12:00+00:00, run_after=2024-04-03T02:13:00+00:00 2024-04-03T02:12:05.556615797Z [2024-04-03T02:12:05.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:11:00+00:00 exited with status success for try_number 1 2024-04-03T02:12:05.568471962Z [2024-04-03T02:12:05.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:11:00+00:00, map_index=-1, run_start_date=2024-04-03 02:12:02.949235+00:00, run_end_date=2024-04-03 02:12:05.122911+00:00, run_duration=2.173676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:12:00.135525+00:00, queued_by_job_id=1, pid=3680 2024-04-03T02:12:06.164867353Z [2024-04-03T02:12:06.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:12:06.165196183Z [2024-04-03T02:12:06.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:11:00+00:00, run_id=scheduled__2024-04-03T02:11:00+00:00, run_start_date=2024-04-03 02:12:00.083411+00:00, run_end_date=2024-04-03 02:12:06.164786+00:00, run_duration=6.081375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:11:00+00:00, data_interval_end=2024-04-03 02:12:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:12:06.184198145Z [2024-04-03T02:12:06.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:12:00+00:00, run_after=2024-04-03T02:13:00+00:00 2024-04-03T02:12:06.223602892Z [2024-04-03T02:12:06.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:11:00+00:00 exited with status success for try_number 1 2024-04-03T02:12:06.228217891Z [2024-04-03T02:12:06.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:11:00+00:00, map_index=-1, run_start_date=2024-04-03 02:12:03.082105+00:00, run_end_date=2024-04-03 02:12:05.576166+00:00, run_duration=2.494061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:12:00.135525+00:00, queued_by_job_id=1, pid=3681 2024-04-03T02:13:00.892037293Z [2024-04-03T02:13:00.891+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:13:00.909729326Z [2024-04-03T02:13:00.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:13:00+00:00, run_after=2024-04-03T02:14:00+00:00 2024-04-03T02:13:00.986958265Z [2024-04-03T02:13:00.986+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:13:00.986981208Z 2024-04-03T02:13:00.986988259Z 2024-04-03T02:13:00.987055601Z [2024-04-03T02:13:00.986+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:13:00.987205925Z [2024-04-03T02:13:00.987+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:13:00.988085447Z [2024-04-03T02:13:00.987+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:13:00.988097243Z 2024-04-03T02:13:00.988100673Z 2024-04-03T02:13:00.992208494Z [2024-04-03T02:13:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:13:00.992503358Z [2024-04-03T02:13:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:13:00.995107245Z [2024-04-03T02:13:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:13:00.995407279Z [2024-04-03T02:13:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:13:01.237180392Z [2024-04-03T02:13:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:12:00+00:00 exited with status queued for try_number 1 2024-04-03T02:13:01.237717583Z [2024-04-03T02:13:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:12:00+00:00 exited with status queued for try_number 1 2024-04-03T02:13:01.258682051Z [2024-04-03T02:13:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ab3a52f-ee15-4b01-a01a-c9b8ebd0115e 2024-04-03T02:13:01.263252767Z [2024-04-03T02:13:01.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86305345-dc9e-4ec2-bb0e-e1b270b9e153 2024-04-03T02:13:06.034685822Z [2024-04-03T02:13:06.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:13:06.034950652Z [2024-04-03T02:13:06.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:12:00+00:00, run_id=scheduled__2024-04-03T02:12:00+00:00, run_start_date=2024-04-03 02:13:00.933168+00:00, run_end_date=2024-04-03 02:13:06.034611+00:00, run_duration=5.101443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:12:00+00:00, data_interval_end=2024-04-03 02:13:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:13:06.045748869Z [2024-04-03T02:13:06.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:13:00+00:00, run_after=2024-04-03T02:14:00+00:00 2024-04-03T02:13:06.051905141Z [2024-04-03T02:13:06.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:13:06.052161106Z [2024-04-03T02:13:06.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:12:00+00:00, run_id=scheduled__2024-04-03T02:12:00+00:00, run_start_date=2024-04-03 02:13:00.934569+00:00, run_end_date=2024-04-03 02:13:06.051852+00:00, run_duration=5.117283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:12:00+00:00, data_interval_end=2024-04-03 02:13:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:13:06.061526505Z [2024-04-03T02:13:06.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:13:00+00:00, run_after=2024-04-03T02:14:00+00:00 2024-04-03T02:13:06.091910631Z [2024-04-03T02:13:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:12:00+00:00 exited with status success for try_number 1 2024-04-03T02:13:06.091998082Z [2024-04-03T02:13:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:12:00+00:00 exited with status success for try_number 1 2024-04-03T02:13:06.098110821Z [2024-04-03T02:13:06.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:12:00+00:00, map_index=-1, run_start_date=2024-04-03 02:13:03.186103+00:00, run_end_date=2024-04-03 02:13:05.033472+00:00, run_duration=1.847369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:13:00.988697+00:00, queued_by_job_id=1, pid=3736 2024-04-03T02:13:06.098368510Z [2024-04-03T02:13:06.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:12:00+00:00, map_index=-1, run_start_date=2024-04-03 02:13:03.283239+00:00, run_end_date=2024-04-03 02:13:05.549327+00:00, run_duration=2.266088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:13:00.988697+00:00, queued_by_job_id=1, pid=3737 2024-04-03T02:14:00.655304986Z [2024-04-03T02:14:00.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:14:00+00:00, run_after=2024-04-03T02:15:00+00:00 2024-04-03T02:14:00.662412167Z [2024-04-03T02:14:00.662+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:14:00.669410776Z [2024-04-03T02:14:00.669+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:14:00.730506611Z [2024-04-03T02:14:00.730+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:14:00.730534735Z 2024-04-03T02:14:00.730539981Z 2024-04-03T02:14:00.730543124Z 2024-04-03T02:14:00.730997433Z [2024-04-03T02:14:00.730+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:14:00.731192134Z [2024-04-03T02:14:00.731+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:14:00.731479296Z [2024-04-03T02:14:00.731+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:14:00.732117137Z [2024-04-03T02:14:00.731+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:14:00.732123748Z 2024-04-03T02:14:00.732128078Z 2024-04-03T02:14:00.732131284Z 2024-04-03T02:14:00.736133187Z [2024-04-03T02:14:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:14:00.736368368Z [2024-04-03T02:14:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:14:00.737160281Z [2024-04-03T02:14:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:14:00.737402093Z [2024-04-03T02:14:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:14:00.737741018Z [2024-04-03T02:14:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:14:00.737976215Z [2024-04-03T02:14:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:14:01.160771229Z [2024-04-03T02:14:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:12:00+00:00 exited with status queued for try_number 1 2024-04-03T02:14:01.160938790Z [2024-04-03T02:14:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:13:00+00:00 exited with status queued for try_number 1 2024-04-03T02:14:01.161085899Z [2024-04-03T02:14:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:13:00+00:00 exited with status queued for try_number 1 2024-04-03T02:14:01.175869636Z [2024-04-03T02:14:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4f6be94-1d1c-4ad7-af97-dce369dd10ba 2024-04-03T02:14:01.176044816Z [2024-04-03T02:14:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 211335bb-0ea8-41c1-9ffe-af9fa865db35 2024-04-03T02:14:01.176173928Z [2024-04-03T02:14:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7323767b-0a02-4e3a-953d-4499d522bfd9 2024-04-03T02:14:03.608642187Z [2024-04-03T02:14:03.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:14:03.609251619Z [2024-04-03T02:14:03.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:12:00+00:00, run_id=scheduled__2024-04-03T02:12:00+00:00, run_start_date=2024-04-03 02:14:00.678998+00:00, run_end_date=2024-04-03 02:14:03.608759+00:00, run_duration=2.929761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:12:00+00:00, data_interval_end=2024-04-03 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:14:03.625405321Z [2024-04-03T02:14:03.625+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:14:00+00:00, run_after=2024-04-03T02:16:00+00:00 2024-04-03T02:14:03.740335546Z [2024-04-03T02:14:03.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:12:00+00:00 exited with status success for try_number 1 2024-04-03T02:14:03.749233628Z [2024-04-03T02:14:03.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:12:00+00:00, map_index=-1, run_start_date=2024-04-03 02:14:02.020913+00:00, run_end_date=2024-04-03 02:14:02.486851+00:00, run_duration=0.465938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:14:00.732988+00:00, queued_by_job_id=1, pid=3772 2024-04-03T02:14:06.834895588Z [2024-04-03T02:14:06.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:14:06.835446423Z [2024-04-03T02:14:06.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:13:00+00:00, run_id=scheduled__2024-04-03T02:13:00+00:00, run_start_date=2024-04-03 02:14:00.680260+00:00, run_end_date=2024-04-03 02:14:06.835002+00:00, run_duration=6.154742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:13:00+00:00, data_interval_end=2024-04-03 02:14:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:14:06.848874678Z [2024-04-03T02:14:06.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:14:00+00:00, run_after=2024-04-03T02:15:00+00:00 2024-04-03T02:14:06.856898146Z [2024-04-03T02:14:06.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:14:06.857566593Z [2024-04-03T02:14:06.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:13:00+00:00, run_id=scheduled__2024-04-03T02:13:00+00:00, run_start_date=2024-04-03 02:14:00.681215+00:00, run_end_date=2024-04-03 02:14:06.857245+00:00, run_duration=6.17603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:13:00+00:00, data_interval_end=2024-04-03 02:14:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:14:06.866751462Z [2024-04-03T02:14:06.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:14:00+00:00, run_after=2024-04-03T02:15:00+00:00 2024-04-03T02:14:06.901130431Z [2024-04-03T02:14:06.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:13:00+00:00 exited with status success for try_number 1 2024-04-03T02:14:06.907142261Z [2024-04-03T02:14:06.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:13:00+00:00, map_index=-1, run_start_date=2024-04-03 02:14:03.289690+00:00, run_end_date=2024-04-03 02:14:06.624383+00:00, run_duration=3.334693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:14:00.732988+00:00, queued_by_job_id=1, pid=3802 2024-04-03T02:14:08.009435675Z [2024-04-03T02:14:08.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:13:00+00:00 exited with status success for try_number 1 2024-04-03T02:14:08.021894191Z [2024-04-03T02:14:08.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:13:00+00:00, map_index=-1, run_start_date=2024-04-03 02:14:03.429326+00:00, run_end_date=2024-04-03 02:14:06.767250+00:00, run_duration=3.337924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:14:00.732988+00:00, queued_by_job_id=1, pid=3803 2024-04-03T02:15:00.361048137Z [2024-04-03T02:15:00.360+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:15:00.373983662Z [2024-04-03T02:15:00.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:15:00+00:00, run_after=2024-04-03T02:20:00+00:00 2024-04-03T02:15:00.387354333Z [2024-04-03T02:15:00.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:15:00+00:00, run_after=2024-04-03T02:16:00+00:00 2024-04-03T02:15:00.445382877Z [2024-04-03T02:15:00.445+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:15:00.445406303Z 2024-04-03T02:15:00.445410502Z 2024-04-03T02:15:00.445413699Z 2024-04-03T02:15:00.445774561Z [2024-04-03T02:15:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:15:00.446038619Z [2024-04-03T02:15:00.445+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:15:00.446223073Z [2024-04-03T02:15:00.446+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:15:00.446899550Z [2024-04-03T02:15:00.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:15:00.446911386Z 2024-04-03T02:15:00.446915255Z 2024-04-03T02:15:00.446918738Z 2024-04-03T02:15:00.452828470Z [2024-04-03T02:15:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:15:00.453848162Z [2024-04-03T02:15:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:15:00.454230038Z [2024-04-03T02:15:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:15:00.454469444Z [2024-04-03T02:15:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:15:00.455192565Z [2024-04-03T02:15:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:15:00.455988486Z [2024-04-03T02:15:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:15:00.811573171Z [2024-04-03T02:15:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status queued for try_number 1 2024-04-03T02:15:00.817594187Z [2024-04-03T02:15:00.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:14:00+00:00 exited with status queued for try_number 1 2024-04-03T02:15:00.817617783Z [2024-04-03T02:15:00.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:14:00+00:00 exited with status queued for try_number 1 2024-04-03T02:15:00.852297823Z [2024-04-03T02:15:00.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ef60bc9-4356-4a5e-9fef-435fe97ce57e 2024-04-03T02:15:00.854909705Z [2024-04-03T02:15:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46a03e81-4e48-48e6-ae87-fe57223745e3 2024-04-03T02:15:00.856251349Z [2024-04-03T02:15:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9e78a4d-8a01-43f9-a056-8dea77ae45ee 2024-04-03T02:15:05.321969006Z [2024-04-03T02:15:05.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:15:05.322412888Z [2024-04-03T02:15:05.322+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:14:00+00:00, run_id=scheduled__2024-04-03T02:14:00+00:00, run_start_date=2024-04-03 02:15:00.397478+00:00, run_end_date=2024-04-03 02:15:05.322051+00:00, run_duration=4.924573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:14:00+00:00, data_interval_end=2024-04-03 02:15:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:15:05.332185996Z [2024-04-03T02:15:05.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:15:00+00:00, run_after=2024-04-03T02:16:00+00:00 2024-04-03T02:15:05.341070254Z [2024-04-03T02:15:05.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:15:05.341470762Z [2024-04-03T02:15:05.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:14:00+00:00, run_id=scheduled__2024-04-03T02:14:00+00:00, run_start_date=2024-04-03 02:15:00.398634+00:00, run_end_date=2024-04-03 02:15:05.341142+00:00, run_duration=4.942508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:14:00+00:00, data_interval_end=2024-04-03 02:15:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:15:05.351592207Z [2024-04-03T02:15:05.351+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:15:00+00:00, run_after=2024-04-03T02:16:00+00:00 2024-04-03T02:15:05.383804671Z [2024-04-03T02:15:05.383+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:15:05.383840926Z 2024-04-03T02:15:05.384172027Z [2024-04-03T02:15:05.383+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:15:05.384827754Z [2024-04-03T02:15:05.384+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:15:05.384838933Z 2024-04-03T02:15:05.387303773Z [2024-04-03T02:15:05.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:15:05.387609790Z [2024-04-03T02:15:05.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:15:05.434252784Z [2024-04-03T02:15:05.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status queued for try_number 1 2024-04-03T02:15:05.434462083Z [2024-04-03T02:15:05.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status success for try_number 1 2024-04-03T02:15:05.434681114Z [2024-04-03T02:15:05.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:14:00+00:00 exited with status success for try_number 1 2024-04-03T02:15:05.434827679Z [2024-04-03T02:15:05.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:14:00+00:00 exited with status success for try_number 1 2024-04-03T02:15:05.443083330Z [2024-04-03T02:15:05.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:14:00+00:00, map_index=-1, run_start_date=2024-04-03 02:15:02.954439+00:00, run_end_date=2024-04-03 02:15:04.476095+00:00, run_duration=1.521656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:15:00.450065+00:00, queued_by_job_id=1, pid=3859 2024-04-03T02:15:05.443310833Z [2024-04-03T02:15:05.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:14:00+00:00, map_index=-1, run_start_date=2024-04-03 02:15:03.155894+00:00, run_end_date=2024-04-03 02:15:04.860694+00:00, run_duration=1.7048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:15:00.450065+00:00, queued_by_job_id=1, pid=3860 2024-04-03T02:15:05.443540244Z [2024-04-03T02:15:05.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:10:00+00:00, map_index=-1, run_start_date=2024-04-03 02:15:03.720091+00:00, run_end_date=2024-04-03 02:15:04.239898+00:00, run_duration=0.519807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:15:00.450065+00:00, queued_by_job_id=1, pid=3888 2024-04-03T02:15:05.443752395Z [2024-04-03T02:15:05.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3d4f230-bb91-4fc2-8f6f-85e684f9ac3d 2024-04-03T02:15:08.354268630Z [2024-04-03T02:15:08.353+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:15:08.354303605Z 2024-04-03T02:15:08.354317663Z [2024-04-03T02:15:08.354+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:15:08.354913917Z [2024-04-03T02:15:08.354+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:15:08.354930616Z 2024-04-03T02:15:08.357581634Z [2024-04-03T02:15:08.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:15:08.357638084Z [2024-04-03T02:15:08.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:15:08.406578750Z [2024-04-03T02:15:08.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status queued for try_number 1 2024-04-03T02:15:08.406811843Z [2024-04-03T02:15:08.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status success for try_number 1 2024-04-03T02:15:08.413633647Z [2024-04-03T02:15:08.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64901928-4b24-4b3a-b715-59f2717105d8 2024-04-03T02:15:08.413879834Z [2024-04-03T02:15:08.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:10:00+00:00, map_index=-1, run_start_date=2024-04-03 02:15:06.984939+00:00, run_end_date=2024-04-03 02:15:07.294368+00:00, run_duration=0.309429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:15:05.385199+00:00, queued_by_job_id=1, pid=3909 2024-04-03T02:15:10.635621582Z [2024-04-03T02:15:10.635+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:15:10.635646879Z 2024-04-03T02:15:10.635713174Z [2024-04-03T02:15:10.635+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:15:10.636370948Z [2024-04-03T02:15:10.636+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:15:10.636383854Z 2024-04-03T02:15:10.638837760Z [2024-04-03T02:15:10.638+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:15:10.638972949Z [2024-04-03T02:15:10.638+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:15:10.698974900Z [2024-04-03T02:15:10.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status queued for try_number 1 2024-04-03T02:15:10.699039474Z [2024-04-03T02:15:10.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status success for try_number 1 2024-04-03T02:15:10.707992729Z [2024-04-03T02:15:10.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 708f0874-6a98-4ef0-b571-03c625c957f3 2024-04-03T02:15:10.708575798Z [2024-04-03T02:15:10.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:10:00+00:00, map_index=0, run_start_date=2024-04-03 02:15:10.073615+00:00, run_end_date=2024-04-03 02:15:10.482170+00:00, run_duration=0.408555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:15:08.355592+00:00, queued_by_job_id=1, pid=3921 2024-04-03T02:15:13.216377083Z [2024-04-03T02:15:13.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:15:13.216692214Z [2024-04-03T02:15:13.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:10:00+00:00, run_id=scheduled__2024-04-03T02:10:00+00:00, run_start_date=2024-04-03 02:15:00.396337+00:00, run_end_date=2024-04-03 02:15:13.216298+00:00, run_duration=12.819961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:10:00+00:00, data_interval_end=2024-04-03 02:15:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:15:13.228502013Z [2024-04-03T02:15:13.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:15:00+00:00, run_after=2024-04-03T02:20:00+00:00 2024-04-03T02:15:13.256094900Z [2024-04-03T02:15:13.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:10:00+00:00 exited with status success for try_number 1 2024-04-03T02:15:13.266386283Z [2024-04-03T02:15:13.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:10:00+00:00, map_index=-1, run_start_date=2024-04-03 02:15:12.379680+00:00, run_end_date=2024-04-03 02:15:12.758188+00:00, run_duration=0.378508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:15:10.636870+00:00, queued_by_job_id=1, pid=3933 2024-04-03T02:16:00.683450675Z [2024-04-03T02:16:00.682+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:16:00.696257329Z [2024-04-03T02:16:00.695+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:16:00.717254728Z [2024-04-03T02:16:00.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:16:00+00:00, run_after=2024-04-03T02:17:00+00:00 2024-04-03T02:16:00.822985790Z [2024-04-03T02:16:00.819+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:16:00.822997938Z 2024-04-03T02:16:00.823001880Z 2024-04-03T02:16:00.823009043Z 2024-04-03T02:16:00.823012615Z [2024-04-03T02:16:00.819+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:16:00.823015709Z [2024-04-03T02:16:00.819+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:16:00.823018817Z [2024-04-03T02:16:00.819+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:16:00.826980796Z [2024-04-03T02:16:00.820+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:16:00.826988257Z 2024-04-03T02:16:00.826995375Z 2024-04-03T02:16:00.826998632Z 2024-04-03T02:16:00.828117850Z [2024-04-03T02:16:00.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:16:00.828132516Z [2024-04-03T02:16:00.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:16:00.828360077Z [2024-04-03T02:16:00.828+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:16:00.828366511Z [2024-04-03T02:16:00.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:16:00.828981358Z [2024-04-03T02:16:00.828+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:16:00.828990447Z [2024-04-03T02:16:00.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:16:01.162355238Z [2024-04-03T02:16:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:14:00+00:00 exited with status queued for try_number 1 2024-04-03T02:16:01.162466893Z [2024-04-03T02:16:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status queued for try_number 1 2024-04-03T02:16:01.162582476Z [2024-04-03T02:16:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status queued for try_number 1 2024-04-03T02:16:01.171545097Z [2024-04-03T02:16:01.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8eadd0f2-a21a-45a3-86c5-690c18302cd1 2024-04-03T02:16:01.171796187Z [2024-04-03T02:16:01.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e51f5be-ca0a-49f1-ace3-42417eb1409e 2024-04-03T02:16:01.171975073Z [2024-04-03T02:16:01.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6ff8b15-ceaa-4d1f-ba62-dff81781c504 2024-04-03T02:16:02.811797440Z [2024-04-03T02:16:02.807+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:16:02.811835570Z [2024-04-03T02:16:02.808+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:14:00+00:00, run_id=scheduled__2024-04-03T02:14:00+00:00, run_start_date=2024-04-03 02:16:00.734015+00:00, run_end_date=2024-04-03 02:16:02.808180+00:00, run_duration=2.074165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:14:00+00:00, data_interval_end=2024-04-03 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:16:02.826686883Z [2024-04-03T02:16:02.823+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:16:00+00:00, run_after=2024-04-03T02:18:00+00:00 2024-04-03T02:16:02.908474623Z [2024-04-03T02:16:02.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:14:00+00:00 exited with status success for try_number 1 2024-04-03T02:16:02.920465935Z [2024-04-03T02:16:02.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:14:00+00:00, map_index=-1, run_start_date=2024-04-03 02:16:01.871155+00:00, run_end_date=2024-04-03 02:16:02.243070+00:00, run_duration=0.371915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:16:00.823888+00:00, queued_by_job_id=1, pid=3951 2024-04-03T02:16:05.573385662Z [2024-04-03T02:16:05.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:16:05.573761371Z [2024-04-03T02:16:05.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:15:00+00:00, run_id=scheduled__2024-04-03T02:15:00+00:00, run_start_date=2024-04-03 02:16:00.735512+00:00, run_end_date=2024-04-03 02:16:05.573456+00:00, run_duration=4.837944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:15:00+00:00, data_interval_end=2024-04-03 02:16:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:16:05.583060739Z [2024-04-03T02:16:05.582+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:16:00+00:00, run_after=2024-04-03T02:17:00+00:00 2024-04-03T02:16:05.589566994Z [2024-04-03T02:16:05.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:16:05.589981703Z [2024-04-03T02:16:05.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:15:00+00:00, run_id=scheduled__2024-04-03T02:15:00+00:00, run_start_date=2024-04-03 02:16:00.736831+00:00, run_end_date=2024-04-03 02:16:05.589580+00:00, run_duration=4.852749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:15:00+00:00, data_interval_end=2024-04-03 02:16:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:16:05.599445960Z [2024-04-03T02:16:05.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:16:00+00:00, run_after=2024-04-03T02:17:00+00:00 2024-04-03T02:16:05.636119349Z [2024-04-03T02:16:05.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status success for try_number 1 2024-04-03T02:16:05.636376463Z [2024-04-03T02:16:05.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status success for try_number 1 2024-04-03T02:16:05.642921768Z [2024-04-03T02:16:05.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:15:00+00:00, map_index=-1, run_start_date=2024-04-03 02:16:03.537212+00:00, run_end_date=2024-04-03 02:16:05.314904+00:00, run_duration=1.777692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:16:00.823888+00:00, queued_by_job_id=1, pid=3982 2024-04-03T02:16:05.643239726Z [2024-04-03T02:16:05.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:15:00+00:00, map_index=-1, run_start_date=2024-04-03 02:16:03.386957+00:00, run_end_date=2024-04-03 02:16:05.344788+00:00, run_duration=1.957831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:16:00.823888+00:00, queued_by_job_id=1, pid=3981 2024-04-03T02:16:35.285140310Z [2024-04-03T02:16:35.284+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:17:00.022829983Z [2024-04-03T02:17:00.019+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:17:00.034140384Z [2024-04-03T02:17:00.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:17:00+00:00, run_after=2024-04-03T02:18:00+00:00 2024-04-03T02:17:00.098327966Z [2024-04-03T02:17:00.097+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:17:00.098361967Z 2024-04-03T02:17:00.098367032Z 2024-04-03T02:17:00.098371874Z [2024-04-03T02:17:00.098+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:17:00.098503213Z [2024-04-03T02:17:00.098+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:17:00.099183875Z [2024-04-03T02:17:00.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:17:00.099196783Z 2024-04-03T02:17:00.099201566Z 2024-04-03T02:17:00.102496851Z [2024-04-03T02:17:00.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:17:00.102702521Z [2024-04-03T02:17:00.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:17:00.102972815Z [2024-04-03T02:17:00.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:17:00.103078112Z [2024-04-03T02:17:00.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:17:00.371416571Z [2024-04-03T02:17:00.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:16:00+00:00 exited with status queued for try_number 1 2024-04-03T02:17:00.371475335Z [2024-04-03T02:17:00.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:16:00+00:00 exited with status queued for try_number 1 2024-04-03T02:17:00.382255478Z [2024-04-03T02:17:00.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfdd2187-bb30-4996-b962-7d53a3c903cd 2024-04-03T02:17:00.382311956Z [2024-04-03T02:17:00.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2984d7fa-de63-4698-855c-18973dd397c1 2024-04-03T02:17:04.736297949Z [2024-04-03T02:17:04.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:17:04.736733575Z [2024-04-03T02:17:04.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:16:00+00:00, run_id=scheduled__2024-04-03T02:16:00+00:00, run_start_date=2024-04-03 02:17:00.042802+00:00, run_end_date=2024-04-03 02:17:04.736035+00:00, run_duration=4.693233, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:16:00+00:00, data_interval_end=2024-04-03 02:17:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:17:04.750435897Z [2024-04-03T02:17:04.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:17:00+00:00, run_after=2024-04-03T02:18:00+00:00 2024-04-03T02:17:04.761127476Z [2024-04-03T02:17:04.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:17:04.761381128Z [2024-04-03T02:17:04.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:16:00+00:00, run_id=scheduled__2024-04-03T02:16:00+00:00, run_start_date=2024-04-03 02:17:00.043963+00:00, run_end_date=2024-04-03 02:17:04.760921+00:00, run_duration=4.716958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:16:00+00:00, data_interval_end=2024-04-03 02:17:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:17:04.775780350Z [2024-04-03T02:17:04.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:17:00+00:00, run_after=2024-04-03T02:18:00+00:00 2024-04-03T02:17:04.813043342Z [2024-04-03T02:17:04.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:16:00+00:00 exited with status success for try_number 1 2024-04-03T02:17:04.813087290Z [2024-04-03T02:17:04.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:16:00+00:00 exited with status success for try_number 1 2024-04-03T02:17:04.831184534Z [2024-04-03T02:17:04.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:16:00+00:00, map_index=-1, run_start_date=2024-04-03 02:17:02.400564+00:00, run_end_date=2024-04-03 02:17:04.125950+00:00, run_duration=1.725386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:17:00.099702+00:00, queued_by_job_id=1, pid=4036 2024-04-03T02:17:04.832638835Z [2024-04-03T02:17:04.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:16:00+00:00, map_index=-1, run_start_date=2024-04-03 02:17:02.514344+00:00, run_end_date=2024-04-03 02:17:03.965287+00:00, run_duration=1.450943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:17:00.099702+00:00, queued_by_job_id=1, pid=4037 2024-04-03T02:18:00.392616285Z [2024-04-03T02:18:00.391+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:18:00.405744817Z [2024-04-03T02:18:00.405+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:18:00.422796608Z [2024-04-03T02:18:00.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:18:00+00:00, run_after=2024-04-03T02:19:00+00:00 2024-04-03T02:18:00.491930700Z [2024-04-03T02:18:00.491+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:18:00.491965327Z 2024-04-03T02:18:00.491971481Z 2024-04-03T02:18:00.491977640Z 2024-04-03T02:18:00.492080320Z [2024-04-03T02:18:00.491+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:18:00.492087230Z [2024-04-03T02:18:00.491+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:18:00.492091631Z [2024-04-03T02:18:00.491+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:18:00.492671910Z [2024-04-03T02:18:00.492+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:18:00.492684432Z 2024-04-03T02:18:00.492691343Z 2024-04-03T02:18:00.492697634Z 2024-04-03T02:18:00.496085569Z [2024-04-03T02:18:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:18:00.496178020Z [2024-04-03T02:18:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:18:00.496402444Z [2024-04-03T02:18:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:18:00.496483388Z [2024-04-03T02:18:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:18:00.496659345Z [2024-04-03T02:18:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:18:00.496730425Z [2024-04-03T02:18:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:18:00.931524267Z [2024-04-03T02:18:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:16:00+00:00 exited with status queued for try_number 1 2024-04-03T02:18:00.931761272Z [2024-04-03T02:18:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:17:00+00:00 exited with status queued for try_number 1 2024-04-03T02:18:00.931953886Z [2024-04-03T02:18:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:17:00+00:00 exited with status queued for try_number 1 2024-04-03T02:18:00.945503331Z [2024-04-03T02:18:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d076b17-b505-4f2e-aa9c-4642993c4ecc 2024-04-03T02:18:00.949245376Z [2024-04-03T02:18:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10243e28-db9f-45f7-ad74-0a964599dc97 2024-04-03T02:18:00.949524694Z [2024-04-03T02:18:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a77716b-23e1-4fbe-a35e-689a12b1d0e9 2024-04-03T02:18:02.147589935Z [2024-04-03T02:18:02.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:18:02.148230644Z [2024-04-03T02:18:02.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:16:00+00:00, run_id=scheduled__2024-04-03T02:16:00+00:00, run_start_date=2024-04-03 02:18:00.436853+00:00, run_end_date=2024-04-03 02:18:02.147724+00:00, run_duration=1.710871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:16:00+00:00, data_interval_end=2024-04-03 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:18:02.162947372Z [2024-04-03T02:18:02.162+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:18:00+00:00, run_after=2024-04-03T02:20:00+00:00 2024-04-03T02:18:03.323701885Z [2024-04-03T02:18:03.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:16:00+00:00 exited with status success for try_number 1 2024-04-03T02:18:03.331259708Z [2024-04-03T02:18:03.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:16:00+00:00, map_index=-1, run_start_date=2024-04-03 02:18:01.591900+00:00, run_end_date=2024-04-03 02:18:02.062172+00:00, run_duration=0.470272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:18:00.493291+00:00, queued_by_job_id=1, pid=4072 2024-04-03T02:18:06.150105750Z [2024-04-03T02:18:06.149+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a to 2024-04-03T02:18:00+00:00, run_after=2024-04-03T02:19:00+00:00 2024-04-03T02:18:06.195949287Z [2024-04-03T02:18:06.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:18:06.196411157Z [2024-04-03T02:18:06.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:17:00+00:00, run_id=scheduled__2024-04-03T02:17:00+00:00, run_start_date=2024-04-03 02:18:00.439199+00:00, run_end_date=2024-04-03 02:18:06.195732+00:00, run_duration=5.756533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:17:00+00:00, data_interval_end=2024-04-03 02:18:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:18:06.219666152Z [2024-04-03T02:18:06.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:18:00+00:00, run_after=2024-04-03T02:19:00+00:00 2024-04-03T02:18:06.237439322Z [2024-04-03T02:18:06.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:18:06.237487202Z [2024-04-03T02:18:06.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:17:00+00:00, run_id=scheduled__2024-04-03T02:17:00+00:00, run_start_date=2024-04-03 02:18:00.438137+00:00, run_end_date=2024-04-03 02:18:06.236824+00:00, run_duration=5.798687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:17:00+00:00, data_interval_end=2024-04-03 02:18:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:18:06.253535675Z [2024-04-03T02:18:06.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:18:00+00:00, run_after=2024-04-03T02:19:00+00:00 2024-04-03T02:18:06.280641382Z [2024-04-03T02:18:06.279+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:18:06.280680649Z 2024-04-03T02:18:06.280686571Z [2024-04-03T02:18:06.280+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a has 0/16 running and queued tasks 2024-04-03T02:18:06.282139064Z [2024-04-03T02:18:06.281+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:18:06.282166447Z 2024-04-03T02:18:06.284700085Z [2024-04-03T02:18:06.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:18:06.284801209Z [2024-04-03T02:18:06.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-03T02:18:06.359513845Z [2024-04-03T02:18:06.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:17:00+00:00 exited with status queued for try_number 1 2024-04-03T02:18:06.360244809Z [2024-04-03T02:18:06.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:17:00+00:00 exited with status success for try_number 1 2024-04-03T02:18:06.360703012Z [2024-04-03T02:18:06.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:17:00+00:00 exited with status success for try_number 1 2024-04-03T02:18:06.373585811Z [2024-04-03T02:18:06.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:17:00+00:00, map_index=-1, run_start_date=2024-04-03 02:18:03.409585+00:00, run_end_date=2024-04-03 02:18:05.126243+00:00, run_duration=1.716658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:18:00.493291+00:00, queued_by_job_id=1, pid=4103 2024-04-03T02:18:06.374431495Z [2024-04-03T02:18:06.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe3727c9-6932-43f5-9c13-d036ed260959 2024-04-03T02:18:06.374932625Z [2024-04-03T02:18:06.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:17:00+00:00, map_index=-1, run_start_date=2024-04-03 02:18:03.083010+00:00, run_end_date=2024-04-03 02:18:05.208348+00:00, run_duration=2.125338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:18:00.493291+00:00, queued_by_job_id=1, pid=4102 2024-04-03T02:18:07.495223668Z [2024-04-03T02:18:07.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:18:07.495555222Z [2024-04-03T02:18:07.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a, execution_date=2024-04-03 02:17:00+00:00, run_id=scheduled__2024-04-03T02:17:00+00:00, run_start_date=2024-04-03 02:18:06.167138+00:00, run_end_date=2024-04-03 02:18:07.495208+00:00, run_duration=1.32807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:17:00+00:00, data_interval_end=2024-04-03 02:18:00+00:00, dag_hash=b58829c777cbc513a47f6444bfadc5a0 2024-04-03T02:18:07.505180259Z [2024-04-03T02:18:07.504+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a to 2024-04-03T02:18:00+00:00, run_after=2024-04-03T02:19:00+00:00 2024-04-03T02:18:08.355239183Z [2024-04-03T02:18:08.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:17:00+00:00 exited with status success for try_number 1 2024-04-03T02:18:08.362149503Z [2024-04-03T02:18:08.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:17:00+00:00, map_index=-1, run_start_date=2024-04-03 02:18:07.083215+00:00, run_end_date=2024-04-03 02:18:07.476327+00:00, run_duration=0.393112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:18:06.282109+00:00, queued_by_job_id=1, pid=4132 2024-04-03T02:19:00.105968711Z [2024-04-03T02:19:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:19:00+00:00, run_after=2024-04-03T02:20:00+00:00 2024-04-03T02:19:00.112986268Z [2024-04-03T02:19:00.112+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:19:00.128633219Z [2024-04-03T02:19:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a to 2024-04-03T02:19:00+00:00, run_after=2024-04-03T02:20:00+00:00 2024-04-03T02:19:00.222041235Z [2024-04-03T02:19:00.221+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:19:00.222067700Z 2024-04-03T02:19:00.222092435Z 2024-04-03T02:19:00.222096685Z 2024-04-03T02:19:00.222485184Z [2024-04-03T02:19:00.222+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:19:00.223780402Z [2024-04-03T02:19:00.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:19:00.227491528Z [2024-04-03T02:19:00.224+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a has 0/16 running and queued tasks 2024-04-03T02:19:00.232162891Z [2024-04-03T02:19:00.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:19:00.232178479Z 2024-04-03T02:19:00.232182190Z 2024-04-03T02:19:00.232185445Z 2024-04-03T02:19:00.237277413Z [2024-04-03T02:19:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:19:00.237774092Z [2024-04-03T02:19:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:19:00.238119113Z [2024-04-03T02:19:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:19:00.238465202Z [2024-04-03T02:19:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:19:00.238880840Z [2024-04-03T02:19:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:19:00.239121095Z [2024-04-03T02:19:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-03T02:19:00.489645835Z [2024-04-03T02:19:00.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status queued for try_number 1 2024-04-03T02:19:00.489992629Z [2024-04-03T02:19:00.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status queued for try_number 1 2024-04-03T02:19:00.490288244Z [2024-04-03T02:19:00.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status queued for try_number 1 2024-04-03T02:19:00.499260504Z [2024-04-03T02:19:00.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to df62647f-9e5e-49cd-83f8-47e195171af9 2024-04-03T02:19:00.499556998Z [2024-04-03T02:19:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b9c7995-a9f4-4d31-b5f1-71885d209944 2024-04-03T02:19:00.499743983Z [2024-04-03T02:19:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6706af8-eb96-4cd9-a653-a37f35b9f952 2024-04-03T02:19:01.721706684Z [2024-04-03T02:19:01.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status failed for try_number 1 2024-04-03T02:19:01.727078579Z [2024-04-03T02:19:01.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:18:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:19:00.233411+00:00, queued_by_job_id=1, pid=None 2024-04-03T02:19:01.727635316Z [2024-04-03T02:19:01.727+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:19:01.729844613Z [2024-04-03T02:19:01.729+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:19:01.745929252Z [2024-04-03T02:19:01.745+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240403T021800, start_date=, end_date=20240403T021901 2024-04-03T02:19:03.964455474Z [2024-04-03T02:19:03.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:19:03.965007725Z [2024-04-03T02:19:03.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:18:00+00:00, run_id=scheduled__2024-04-03T02:18:00+00:00, run_start_date=2024-04-03 02:19:00.139190+00:00, run_end_date=2024-04-03 02:19:03.964362+00:00, run_duration=3.825172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:18:00+00:00, data_interval_end=2024-04-03 02:19:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:19:03.974577455Z [2024-04-03T02:19:03.974+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:19:00+00:00, run_after=2024-04-03T02:20:00+00:00 2024-04-03T02:19:04.032102423Z [2024-04-03T02:19:04.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status success for try_number 1 2024-04-03T02:19:04.037856770Z [2024-04-03T02:19:04.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:18:00+00:00, map_index=-1, run_start_date=2024-04-03 02:19:02.476148+00:00, run_end_date=2024-04-03 02:19:03.828014+00:00, run_duration=1.351866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:19:00.233411+00:00, queued_by_job_id=1, pid=4196 2024-04-03T02:19:05.164557635Z [2024-04-03T02:19:05.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:19:05.165051676Z [2024-04-03T02:19:05.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:18:00+00:00, run_id=scheduled__2024-04-03T02:18:00+00:00, run_start_date=2024-04-03 02:19:00.140158+00:00, run_end_date=2024-04-03 02:19:05.164362+00:00, run_duration=5.024204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:18:00+00:00, data_interval_end=2024-04-03 02:19:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:19:05.176593671Z [2024-04-03T02:19:05.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:19:00+00:00, run_after=2024-04-03T02:20:00+00:00 2024-04-03T02:19:05.214296927Z [2024-04-03T02:19:05.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status success for try_number 1 2024-04-03T02:19:05.218919377Z [2024-04-03T02:19:05.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:18:00+00:00, map_index=-1, run_start_date=2024-04-03 02:19:02.358508+00:00, run_end_date=2024-04-03 02:19:04.419687+00:00, run_duration=2.061179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:19:00.233411+00:00, queued_by_job_id=1, pid=4195 2024-04-03T02:19:12.375519064Z [2024-04-03T02:19:12.375+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:19:12.375578865Z 2024-04-03T02:19:12.375639176Z [2024-04-03T02:19:12.375+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a has 0/16 running and queued tasks 2024-04-03T02:19:12.376313399Z [2024-04-03T02:19:12.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:19:12.376328253Z 2024-04-03T02:19:12.379637534Z [2024-04-03T02:19:12.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:18:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:19:12.379772623Z [2024-04-03T02:19:12.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-03T02:19:12.437772874Z [2024-04-03T02:19:12.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status queued for try_number 2 2024-04-03T02:19:12.445799959Z [2024-04-03T02:19:12.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b6fb8b3-df1e-4dcd-bf3e-9eb00e287bb2 2024-04-03T02:19:13.648446940Z [2024-04-03T02:19:13.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status failed for try_number 2 2024-04-03T02:19:13.662662687Z [2024-04-03T02:19:13.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:18:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-03 02:19:01.732380+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:19:12.376576+00:00, queued_by_job_id=1, pid=None 2024-04-03T02:19:13.663246770Z [2024-04-03T02:19:13.662+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:19:13.665537871Z [2024-04-03T02:19:13.665+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:19:13.683172890Z [2024-04-03T02:19:13.682+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240403T021800, start_date=, end_date=20240403T021913 2024-04-03T02:19:14.237325101Z [2024-04-03T02:19:14.236+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T02:19:14.237646517Z [2024-04-03T02:19:14.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a, execution_date=2024-04-03 02:18:00+00:00, run_id=scheduled__2024-04-03T02:18:00+00:00, run_start_date=2024-04-03 02:19:00.137935+00:00, run_end_date=2024-04-03 02:19:14.237227+00:00, run_duration=14.099292, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:18:00+00:00, data_interval_end=2024-04-03 02:19:00+00:00, dag_hash=b58829c777cbc513a47f6444bfadc5a0 2024-04-03T02:19:14.248269979Z [2024-04-03T02:19:14.247+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a to 2024-04-03T02:19:00+00:00, run_after=2024-04-03T02:20:00+00:00 2024-04-03T02:20:00.820735475Z [2024-04-03T02:20:00.820+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:20:00+00:00, run_after=2024-04-03T02:25:00+00:00 2024-04-03T02:20:00.839499677Z [2024-04-03T02:20:00.839+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:20:00.851710095Z [2024-04-03T02:20:00.851+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:20:00.864369985Z [2024-04-03T02:20:00.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:20:00+00:00, run_after=2024-04-03T02:21:00+00:00 2024-04-03T02:20:00.961718169Z [2024-04-03T02:20:00.961+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T02:20:00.961752525Z 2024-04-03T02:20:00.961760146Z 2024-04-03T02:20:00.961768853Z 2024-04-03T02:20:00.961775636Z 2024-04-03T02:20:00.961793318Z [2024-04-03T02:20:00.961+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:20:00.961800814Z [2024-04-03T02:20:00.961+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:20:00.961876094Z [2024-04-03T02:20:00.961+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:20:00.961953900Z [2024-04-03T02:20:00.961+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:20:00.962527193Z [2024-04-03T02:20:00.962+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:20:00.962544362Z 2024-04-03T02:20:00.962553204Z 2024-04-03T02:20:00.962558797Z 2024-04-03T02:20:00.962563716Z 2024-04-03T02:20:00.966984358Z [2024-04-03T02:20:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:20:00.967078875Z [2024-04-03T02:20:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:20:00.967367870Z [2024-04-03T02:20:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:20:00.967452495Z [2024-04-03T02:20:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:20:00.967794622Z [2024-04-03T02:20:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:20:00.967940052Z [2024-04-03T02:20:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:20:00.968187509Z [2024-04-03T02:20:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:20:00.968266277Z [2024-04-03T02:20:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:20:01.555836636Z [2024-04-03T02:20:01.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status queued for try_number 1 2024-04-03T02:20:01.555911073Z [2024-04-03T02:20:01.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status queued for try_number 1 2024-04-03T02:20:01.555916019Z [2024-04-03T02:20:01.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:19:00+00:00 exited with status queued for try_number 1 2024-04-03T02:20:01.555952994Z [2024-04-03T02:20:01.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:19:00+00:00 exited with status queued for try_number 1 2024-04-03T02:20:01.579140160Z [2024-04-03T02:20:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0faa0174-d43b-40ad-9251-6e58325ec142 2024-04-03T02:20:01.579250614Z [2024-04-03T02:20:01.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02b1034f-e832-4084-8f94-998076e84096 2024-04-03T02:20:01.579340246Z [2024-04-03T02:20:01.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5cba34e-0b0b-4f71-bd3a-f928677abde9 2024-04-03T02:20:01.579418074Z [2024-04-03T02:20:01.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e16d819-d165-4d2e-8cdf-58439f4f2bad 2024-04-03T02:20:02.940102581Z [2024-04-03T02:20:02.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:20:02.940307242Z [2024-04-03T02:20:02.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:18:00+00:00, run_id=scheduled__2024-04-03T02:18:00+00:00, run_start_date=2024-04-03 02:20:00.890666+00:00, run_end_date=2024-04-03 02:20:02.940008+00:00, run_duration=2.049342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:18:00+00:00, data_interval_end=2024-04-03 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:20:02.955340807Z [2024-04-03T02:20:02.955+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:20:00+00:00, run_after=2024-04-03T02:22:00+00:00 2024-04-03T02:20:03.087053365Z [2024-04-03T02:20:03.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:18:00+00:00 exited with status success for try_number 1 2024-04-03T02:20:03.098017520Z [2024-04-03T02:20:03.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:18:00+00:00, map_index=-1, run_start_date=2024-04-03 02:20:02.018825+00:00, run_end_date=2024-04-03 02:20:02.407458+00:00, run_duration=0.388633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:20:00.963592+00:00, queued_by_job_id=1, pid=4252 2024-04-03T02:20:04.243576973Z [2024-04-03T02:20:04.243+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:20:04.243601075Z 2024-04-03T02:20:04.243814698Z [2024-04-03T02:20:04.243+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:20:04.244427366Z [2024-04-03T02:20:04.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:20:04.244439089Z 2024-04-03T02:20:04.250076553Z [2024-04-03T02:20:04.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:20:04.250483314Z [2024-04-03T02:20:04.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:20:04.359859112Z [2024-04-03T02:20:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status queued for try_number 1 2024-04-03T02:20:04.359879020Z [2024-04-03T02:20:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status success for try_number 1 2024-04-03T02:20:04.370463589Z [2024-04-03T02:20:04.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59b8742e-7abb-4de4-8de5-27eb977ef8ad 2024-04-03T02:20:04.370703401Z [2024-04-03T02:20:04.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:15:00+00:00, map_index=-1, run_start_date=2024-04-03 02:20:03.547771+00:00, run_end_date=2024-04-03 02:20:04.111781+00:00, run_duration=0.56401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:20:00.963592+00:00, queued_by_job_id=1, pid=4283 2024-04-03T02:20:05.559715821Z [2024-04-03T02:20:05.559+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:20:05.559972926Z [2024-04-03T02:20:05.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:19:00+00:00, run_id=scheduled__2024-04-03T02:19:00+00:00, run_start_date=2024-04-03 02:20:00.891728+00:00, run_end_date=2024-04-03 02:20:05.559640+00:00, run_duration=4.667912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:19:00+00:00, data_interval_end=2024-04-03 02:20:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:20:05.571241323Z [2024-04-03T02:20:05.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:20:00+00:00, run_after=2024-04-03T02:21:00+00:00 2024-04-03T02:20:06.728754287Z [2024-04-03T02:20:06.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:20:06.729411608Z [2024-04-03T02:20:06.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:19:00+00:00, run_id=scheduled__2024-04-03T02:19:00+00:00, run_start_date=2024-04-03 02:20:00.892681+00:00, run_end_date=2024-04-03 02:20:06.728819+00:00, run_duration=5.836138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:19:00+00:00, data_interval_end=2024-04-03 02:20:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:20:06.742824694Z [2024-04-03T02:20:06.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:20:00+00:00, run_after=2024-04-03T02:21:00+00:00 2024-04-03T02:20:06.776398783Z [2024-04-03T02:20:06.776+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:20:06.776433319Z 2024-04-03T02:20:06.778091287Z [2024-04-03T02:20:06.777+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:20:06.779328636Z [2024-04-03T02:20:06.779+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:20:06.779341762Z 2024-04-03T02:20:06.783066473Z [2024-04-03T02:20:06.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:20:06.783243827Z [2024-04-03T02:20:06.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:20:06.869430651Z [2024-04-03T02:20:06.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status queued for try_number 1 2024-04-03T02:20:06.869524804Z [2024-04-03T02:20:06.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:19:00+00:00 exited with status success for try_number 1 2024-04-03T02:20:06.869677875Z [2024-04-03T02:20:06.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:19:00+00:00 exited with status success for try_number 1 2024-04-03T02:20:06.869799911Z [2024-04-03T02:20:06.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status success for try_number 1 2024-04-03T02:20:06.886268166Z [2024-04-03T02:20:06.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:19:00+00:00, map_index=-1, run_start_date=2024-04-03 02:20:03.957866+00:00, run_end_date=2024-04-03 02:20:05.531495+00:00, run_duration=1.573629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:20:00.963592+00:00, queued_by_job_id=1, pid=4302 2024-04-03T02:20:06.886377470Z [2024-04-03T02:20:06.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:19:00+00:00, map_index=-1, run_start_date=2024-04-03 02:20:03.702324+00:00, run_end_date=2024-04-03 02:20:05.656098+00:00, run_duration=1.953774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:20:00.963592+00:00, queued_by_job_id=1, pid=4286 2024-04-03T02:20:06.886653839Z [2024-04-03T02:20:06.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:15:00+00:00, map_index=-1, run_start_date=2024-04-03 02:20:05.990342+00:00, run_end_date=2024-04-03 02:20:06.283149+00:00, run_duration=0.292807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:20:04.245343+00:00, queued_by_job_id=1, pid=4332 2024-04-03T02:20:06.887021965Z [2024-04-03T02:20:06.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4bea4ba-168f-4d6e-b161-728e2b2e21bc 2024-04-03T02:20:09.953695818Z [2024-04-03T02:20:09.953+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:20:09.953724588Z 2024-04-03T02:20:09.953943505Z [2024-04-03T02:20:09.953+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:20:09.954916022Z [2024-04-03T02:20:09.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:20:09.954927071Z 2024-04-03T02:20:09.957671079Z [2024-04-03T02:20:09.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:20:09.958041943Z [2024-04-03T02:20:09.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:20:10.026742818Z [2024-04-03T02:20:10.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status queued for try_number 1 2024-04-03T02:20:10.026766963Z [2024-04-03T02:20:10.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status success for try_number 1 2024-04-03T02:20:10.045744020Z [2024-04-03T02:20:10.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to e762812a-938d-49d5-82c8-3d0d09daa8af 2024-04-03T02:20:10.045985730Z [2024-04-03T02:20:10.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:15:00+00:00, map_index=0, run_start_date=2024-04-03 02:20:08.685143+00:00, run_end_date=2024-04-03 02:20:09.015781+00:00, run_duration=0.330638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:20:06.780398+00:00, queued_by_job_id=1, pid=4344 2024-04-03T02:20:12.324193981Z [2024-04-03T02:20:12.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:20:12.324429784Z [2024-04-03T02:20:12.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:15:00+00:00, run_id=scheduled__2024-04-03T02:15:00+00:00, run_start_date=2024-04-03 02:20:00.888513+00:00, run_end_date=2024-04-03 02:20:12.324123+00:00, run_duration=11.43561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:15:00+00:00, data_interval_end=2024-04-03 02:20:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:20:12.333210650Z [2024-04-03T02:20:12.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:20:00+00:00, run_after=2024-04-03T02:25:00+00:00 2024-04-03T02:20:12.369508893Z [2024-04-03T02:20:12.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:15:00+00:00 exited with status success for try_number 1 2024-04-03T02:20:12.375619675Z [2024-04-03T02:20:12.375+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:15:00+00:00, map_index=-1, run_start_date=2024-04-03 02:20:11.753571+00:00, run_end_date=2024-04-03 02:20:12.127423+00:00, run_duration=0.373852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:20:09.955429+00:00, queued_by_job_id=1, pid=4356 2024-04-03T02:21:00.358761731Z [2024-04-03T02:21:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:21:00+00:00, run_after=2024-04-03T02:22:00+00:00 2024-04-03T02:21:00.368002592Z [2024-04-03T02:21:00.366+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:21:00.420210751Z [2024-04-03T02:21:00.419+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:21:00.420238297Z 2024-04-03T02:21:00.420241540Z 2024-04-03T02:21:00.420292201Z [2024-04-03T02:21:00.420+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:21:00.420308351Z [2024-04-03T02:21:00.420+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:21:00.420914965Z [2024-04-03T02:21:00.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:21:00.420926477Z 2024-04-03T02:21:00.420930403Z 2024-04-03T02:21:00.423647056Z [2024-04-03T02:21:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:21:00.423742575Z [2024-04-03T02:21:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:21:00.423947990Z [2024-04-03T02:21:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:21:00.424031944Z [2024-04-03T02:21:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:21:00.679453223Z [2024-04-03T02:21:00.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status queued for try_number 1 2024-04-03T02:21:00.681006647Z [2024-04-03T02:21:00.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status queued for try_number 1 2024-04-03T02:21:00.705444474Z [2024-04-03T02:21:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to d84485dd-271b-4a9e-ab25-43ea19ca428d 2024-04-03T02:21:00.706000163Z [2024-04-03T02:21:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2abe6c71-1687-4bd6-a776-96de8b2a463f 2024-04-03T02:21:04.073685816Z [2024-04-03T02:21:04.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:21:04.074186327Z [2024-04-03T02:21:04.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:20:00+00:00, run_id=scheduled__2024-04-03T02:20:00+00:00, run_start_date=2024-04-03 02:21:00.379570+00:00, run_end_date=2024-04-03 02:21:04.073781+00:00, run_duration=3.694211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:20:00+00:00, data_interval_end=2024-04-03 02:21:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:21:04.083492515Z [2024-04-03T02:21:04.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:21:00+00:00, run_after=2024-04-03T02:22:00+00:00 2024-04-03T02:21:04.126435216Z [2024-04-03T02:21:04.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status success for try_number 1 2024-04-03T02:21:04.133706812Z [2024-04-03T02:21:04.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:20:00+00:00, map_index=-1, run_start_date=2024-04-03 02:21:02.592702+00:00, run_end_date=2024-04-03 02:21:03.898699+00:00, run_duration=1.305997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:21:00.421453+00:00, queued_by_job_id=1, pid=4392 2024-04-03T02:21:05.178852599Z [2024-04-03T02:21:05.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:21:05.179125335Z [2024-04-03T02:21:05.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:20:00+00:00, run_id=scheduled__2024-04-03T02:20:00+00:00, run_start_date=2024-04-03 02:21:00.381000+00:00, run_end_date=2024-04-03 02:21:05.178822+00:00, run_duration=4.797822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:20:00+00:00, data_interval_end=2024-04-03 02:21:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:21:05.189014788Z [2024-04-03T02:21:05.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:21:00+00:00, run_after=2024-04-03T02:22:00+00:00 2024-04-03T02:21:05.216175448Z [2024-04-03T02:21:05.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status success for try_number 1 2024-04-03T02:21:05.221737311Z [2024-04-03T02:21:05.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:20:00+00:00, map_index=-1, run_start_date=2024-04-03 02:21:02.517959+00:00, run_end_date=2024-04-03 02:21:04.187272+00:00, run_duration=1.669313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:21:00.421453+00:00, queued_by_job_id=1, pid=4391 2024-04-03T02:21:35.296437827Z [2024-04-03T02:21:35.295+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:22:00.686562598Z [2024-04-03T02:22:00.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:22:00+00:00, run_after=2024-04-03T02:23:00+00:00 2024-04-03T02:22:00.694904138Z [2024-04-03T02:22:00.694+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:22:00.706352765Z [2024-04-03T02:22:00.705+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:22:00.810797536Z [2024-04-03T02:22:00.803+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:22:00.810828301Z 2024-04-03T02:22:00.810832707Z 2024-04-03T02:22:00.810836077Z 2024-04-03T02:22:00.810840136Z [2024-04-03T02:22:00.804+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:22:00.810843364Z [2024-04-03T02:22:00.804+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:22:00.810847183Z [2024-04-03T02:22:00.804+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:22:00.810850380Z [2024-04-03T02:22:00.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:22:00.810866277Z 2024-04-03T02:22:00.810869834Z 2024-04-03T02:22:00.810872951Z 2024-04-03T02:22:00.823302378Z [2024-04-03T02:22:00.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:22:00.823331853Z [2024-04-03T02:22:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:22:00.823346962Z [2024-04-03T02:22:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:22:00.823350553Z [2024-04-03T02:22:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:22:00.823354001Z [2024-04-03T02:22:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:22:00.823357165Z [2024-04-03T02:22:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:22:01.144631957Z [2024-04-03T02:22:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status queued for try_number 1 2024-04-03T02:22:01.144685037Z [2024-04-03T02:22:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:21:00+00:00 exited with status queued for try_number 1 2024-04-03T02:22:01.144689406Z [2024-04-03T02:22:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:21:00+00:00 exited with status queued for try_number 1 2024-04-03T02:22:01.158959357Z [2024-04-03T02:22:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30757063-e1a6-484e-b98a-f555686569c8 2024-04-03T02:22:01.158992923Z [2024-04-03T02:22:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 805fbaac-4048-43fa-9536-c624bd4ee0fb 2024-04-03T02:22:01.159071897Z [2024-04-03T02:22:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8f5ab66-78f6-4f1d-baea-e096f118a015 2024-04-03T02:22:02.665792700Z [2024-04-03T02:22:02.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:22:02.666063347Z [2024-04-03T02:22:02.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:20:00+00:00, run_id=scheduled__2024-04-03T02:20:00+00:00, run_start_date=2024-04-03 02:22:00.716587+00:00, run_end_date=2024-04-03 02:22:02.665629+00:00, run_duration=1.949042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:20:00+00:00, data_interval_end=2024-04-03 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:22:02.680792590Z [2024-04-03T02:22:02.679+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:22:00+00:00, run_after=2024-04-03T02:24:00+00:00 2024-04-03T02:22:03.855799935Z [2024-04-03T02:22:03.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status success for try_number 1 2024-04-03T02:22:03.867330957Z [2024-04-03T02:22:03.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:20:00+00:00, map_index=-1, run_start_date=2024-04-03 02:22:02.147301+00:00, run_end_date=2024-04-03 02:22:02.644155+00:00, run_duration=0.496854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:22:00.807121+00:00, queued_by_job_id=1, pid=4427 2024-04-03T02:22:06.007309228Z [2024-04-03T02:22:06.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:22:06.007663435Z [2024-04-03T02:22:06.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:21:00+00:00, run_id=scheduled__2024-04-03T02:21:00+00:00, run_start_date=2024-04-03 02:22:00.717893+00:00, run_end_date=2024-04-03 02:22:06.007196+00:00, run_duration=5.289303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:21:00+00:00, data_interval_end=2024-04-03 02:22:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:22:06.016888450Z [2024-04-03T02:22:06.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:22:00+00:00, run_after=2024-04-03T02:23:00+00:00 2024-04-03T02:22:06.054990167Z [2024-04-03T02:22:06.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:21:00+00:00 exited with status success for try_number 1 2024-04-03T02:22:06.060927407Z [2024-04-03T02:22:06.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:21:00+00:00, map_index=-1, run_start_date=2024-04-03 02:22:03.716870+00:00, run_end_date=2024-04-03 02:22:05.485220+00:00, run_duration=1.76835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:22:00.807121+00:00, queued_by_job_id=1, pid=4457 2024-04-03T02:22:07.802222662Z [2024-04-03T02:22:07.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:22:07.802427915Z [2024-04-03T02:22:07.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:21:00+00:00, run_id=scheduled__2024-04-03T02:21:00+00:00, run_start_date=2024-04-03 02:22:00.718987+00:00, run_end_date=2024-04-03 02:22:07.802150+00:00, run_duration=7.083163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:21:00+00:00, data_interval_end=2024-04-03 02:22:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:22:07.813700307Z [2024-04-03T02:22:07.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:22:00+00:00, run_after=2024-04-03T02:23:00+00:00 2024-04-03T02:22:07.853507038Z [2024-04-03T02:22:07.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:21:00+00:00 exited with status success for try_number 1 2024-04-03T02:22:07.859824338Z [2024-04-03T02:22:07.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:21:00+00:00, map_index=-1, run_start_date=2024-04-03 02:22:03.918288+00:00, run_end_date=2024-04-03 02:22:06.913835+00:00, run_duration=2.995547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:22:00.807121+00:00, queued_by_job_id=1, pid=4458 2024-04-03T02:23:01.063864576Z [2024-04-03T02:23:01.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:23:00+00:00, run_after=2024-04-03T02:24:00+00:00 2024-04-03T02:23:01.070484003Z [2024-04-03T02:23:01.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:23:01.127326159Z [2024-04-03T02:23:01.126+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:23:01.127384678Z 2024-04-03T02:23:01.127388691Z 2024-04-03T02:23:01.127461637Z [2024-04-03T02:23:01.127+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:23:01.127467055Z [2024-04-03T02:23:01.127+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:23:01.127926362Z [2024-04-03T02:23:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:23:01.127935908Z 2024-04-03T02:23:01.127939398Z 2024-04-03T02:23:01.134687388Z [2024-04-03T02:23:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:23:01.134775842Z [2024-04-03T02:23:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:23:01.134951779Z [2024-04-03T02:23:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:23:01.135024213Z [2024-04-03T02:23:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:23:01.313416780Z [2024-04-03T02:23:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:22:00+00:00 exited with status queued for try_number 1 2024-04-03T02:23:01.313458499Z [2024-04-03T02:23:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:22:00+00:00 exited with status queued for try_number 1 2024-04-03T02:23:01.322987523Z [2024-04-03T02:23:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce491bb5-cc2d-45c5-880f-6173685d4c6d 2024-04-03T02:23:01.323066627Z [2024-04-03T02:23:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42fdbba3-9ba8-4509-93e7-30f79d28084c 2024-04-03T02:23:05.674244245Z [2024-04-03T02:23:05.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:23:05.674695218Z [2024-04-03T02:23:05.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:22:00+00:00, run_id=scheduled__2024-04-03T02:22:00+00:00, run_start_date=2024-04-03 02:23:01.082558+00:00, run_end_date=2024-04-03 02:23:05.674121+00:00, run_duration=4.591563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:22:00+00:00, data_interval_end=2024-04-03 02:23:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:23:05.685060228Z [2024-04-03T02:23:05.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:23:00+00:00, run_after=2024-04-03T02:24:00+00:00 2024-04-03T02:23:05.694944689Z [2024-04-03T02:23:05.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:23:05.695225811Z [2024-04-03T02:23:05.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:22:00+00:00, run_id=scheduled__2024-04-03T02:22:00+00:00, run_start_date=2024-04-03 02:23:01.084175+00:00, run_end_date=2024-04-03 02:23:05.694806+00:00, run_duration=4.610631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:22:00+00:00, data_interval_end=2024-04-03 02:23:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:23:05.705184787Z [2024-04-03T02:23:05.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:23:00+00:00, run_after=2024-04-03T02:24:00+00:00 2024-04-03T02:23:05.734717639Z [2024-04-03T02:23:05.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:22:00+00:00 exited with status success for try_number 1 2024-04-03T02:23:05.735019156Z [2024-04-03T02:23:05.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:22:00+00:00 exited with status success for try_number 1 2024-04-03T02:23:05.741780022Z [2024-04-03T02:23:05.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:22:00+00:00, map_index=-1, run_start_date=2024-04-03 02:23:02.940890+00:00, run_end_date=2024-04-03 02:23:04.663745+00:00, run_duration=1.722855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:23:01.129130+00:00, queued_by_job_id=1, pid=4512 2024-04-03T02:23:05.742173641Z [2024-04-03T02:23:05.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:22:00+00:00, map_index=-1, run_start_date=2024-04-03 02:23:03.031007+00:00, run_end_date=2024-04-03 02:23:05.274987+00:00, run_duration=2.24398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:23:01.129130+00:00, queued_by_job_id=1, pid=4513 2024-04-03T02:24:00.189983533Z [2024-04-03T02:24:00.188+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:24:00.205400742Z [2024-04-03T02:24:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:24:00+00:00, run_after=2024-04-03T02:25:00+00:00 2024-04-03T02:24:00.214121341Z [2024-04-03T02:24:00.213+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:24:00.270896097Z [2024-04-03T02:24:00.270+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:24:00.270927076Z 2024-04-03T02:24:00.270931625Z 2024-04-03T02:24:00.270934920Z 2024-04-03T02:24:00.270981319Z [2024-04-03T02:24:00.270+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:24:00.271058035Z [2024-04-03T02:24:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:24:00.271152597Z [2024-04-03T02:24:00.271+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:24:00.271696241Z [2024-04-03T02:24:00.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:24:00.271703087Z 2024-04-03T02:24:00.271706485Z 2024-04-03T02:24:00.271709639Z 2024-04-03T02:24:00.275212037Z [2024-04-03T02:24:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:24:00.275305875Z [2024-04-03T02:24:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:24:00.275502981Z [2024-04-03T02:24:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:24:00.275629253Z [2024-04-03T02:24:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:24:00.275774284Z [2024-04-03T02:24:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:24:00.275830593Z [2024-04-03T02:24:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:24:00.508954351Z [2024-04-03T02:24:00.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:22:00+00:00 exited with status queued for try_number 1 2024-04-03T02:24:00.509236364Z [2024-04-03T02:24:00.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:23:00+00:00 exited with status queued for try_number 1 2024-04-03T02:24:00.509523607Z [2024-04-03T02:24:00.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:23:00+00:00 exited with status queued for try_number 1 2024-04-03T02:24:00.518721957Z [2024-04-03T02:24:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 471a9c3c-f898-44bb-b7b2-57ebf4672ec2 2024-04-03T02:24:00.519019050Z [2024-04-03T02:24:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to d90f33ba-48bb-484c-8ad9-51ee21b7ce04 2024-04-03T02:24:00.519249641Z [2024-04-03T02:24:00.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to f26e809d-d29e-4370-ae62-0223ebc4da0b 2024-04-03T02:24:02.878291484Z [2024-04-03T02:24:02.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:24:02.878512606Z [2024-04-03T02:24:02.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:22:00+00:00, run_id=scheduled__2024-04-03T02:22:00+00:00, run_start_date=2024-04-03 02:24:00.223711+00:00, run_end_date=2024-04-03 02:24:02.878210+00:00, run_duration=2.654499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:22:00+00:00, data_interval_end=2024-04-03 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:24:02.888403588Z [2024-04-03T02:24:02.888+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:24:00+00:00, run_after=2024-04-03T02:26:00+00:00 2024-04-03T02:24:02.985040403Z [2024-04-03T02:24:02.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:22:00+00:00 exited with status success for try_number 1 2024-04-03T02:24:02.998068513Z [2024-04-03T02:24:02.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:22:00+00:00, map_index=-1, run_start_date=2024-04-03 02:24:01.559980+00:00, run_end_date=2024-04-03 02:24:02.074830+00:00, run_duration=0.51485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:24:00.272381+00:00, queued_by_job_id=1, pid=4548 2024-04-03T02:24:04.323348718Z [2024-04-03T02:24:04.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:24:04.323723825Z [2024-04-03T02:24:04.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:23:00+00:00, run_id=scheduled__2024-04-03T02:23:00+00:00, run_start_date=2024-04-03 02:24:00.225361+00:00, run_end_date=2024-04-03 02:24:04.323223+00:00, run_duration=4.097862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:23:00+00:00, data_interval_end=2024-04-03 02:24:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:24:04.334869152Z [2024-04-03T02:24:04.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:24:00+00:00, run_after=2024-04-03T02:25:00+00:00 2024-04-03T02:24:04.380070461Z [2024-04-03T02:24:04.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:23:00+00:00 exited with status success for try_number 1 2024-04-03T02:24:04.387367567Z [2024-04-03T02:24:04.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:23:00+00:00, map_index=-1, run_start_date=2024-04-03 02:24:02.661251+00:00, run_end_date=2024-04-03 02:24:04.022706+00:00, run_duration=1.361455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:24:00.272381+00:00, queued_by_job_id=1, pid=4578 2024-04-03T02:24:05.432822085Z [2024-04-03T02:24:05.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:24:05.432952010Z [2024-04-03T02:24:05.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:23:00+00:00, run_id=scheduled__2024-04-03T02:23:00+00:00, run_start_date=2024-04-03 02:24:00.226385+00:00, run_end_date=2024-04-03 02:24:05.432613+00:00, run_duration=5.206228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:23:00+00:00, data_interval_end=2024-04-03 02:24:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:24:05.442070408Z [2024-04-03T02:24:05.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:24:00+00:00, run_after=2024-04-03T02:25:00+00:00 2024-04-03T02:24:05.482265287Z [2024-04-03T02:24:05.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:23:00+00:00 exited with status success for try_number 1 2024-04-03T02:24:05.487174632Z [2024-04-03T02:24:05.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:23:00+00:00, map_index=-1, run_start_date=2024-04-03 02:24:02.912884+00:00, run_end_date=2024-04-03 02:24:04.521664+00:00, run_duration=1.60878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:24:00.272381+00:00, queued_by_job_id=1, pid=4579 2024-04-03T02:25:00.906378286Z [2024-04-03T02:25:00.905+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:25:00.926256709Z [2024-04-03T02:25:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:25:00+00:00, run_after=2024-04-03T02:30:00+00:00 2024-04-03T02:25:00.940320808Z [2024-04-03T02:25:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:25:00+00:00, run_after=2024-04-03T02:26:00+00:00 2024-04-03T02:25:01.033769885Z [2024-04-03T02:25:01.033+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:25:01.033793273Z 2024-04-03T02:25:01.033797310Z 2024-04-03T02:25:01.033800610Z 2024-04-03T02:25:01.033912798Z [2024-04-03T02:25:01.033+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:25:01.034082291Z [2024-04-03T02:25:01.033+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:25:01.034268323Z [2024-04-03T02:25:01.034+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:25:01.034881870Z [2024-04-03T02:25:01.034+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:25:01.034893411Z 2024-04-03T02:25:01.034897290Z 2024-04-03T02:25:01.034900494Z 2024-04-03T02:25:01.037943541Z [2024-04-03T02:25:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:25:01.038136012Z [2024-04-03T02:25:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:25:01.038441855Z [2024-04-03T02:25:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:25:01.038631609Z [2024-04-03T02:25:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:25:01.038887798Z [2024-04-03T02:25:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:25:01.039162687Z [2024-04-03T02:25:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:25:01.405706395Z [2024-04-03T02:25:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status queued for try_number 1 2024-04-03T02:25:01.405895581Z [2024-04-03T02:25:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:24:00+00:00 exited with status queued for try_number 1 2024-04-03T02:25:01.406566536Z [2024-04-03T02:25:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:24:00+00:00 exited with status queued for try_number 1 2024-04-03T02:25:01.415261250Z [2024-04-03T02:25:01.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to 935a031e-1cb8-448a-a7dc-a9fc5c6571b9 2024-04-03T02:25:01.415508757Z [2024-04-03T02:25:01.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to 873644a2-f915-48e8-9fd9-6616b1afd8cf 2024-04-03T02:25:01.415722334Z [2024-04-03T02:25:01.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4ba8865-bf16-4d39-b9c8-a8927fba70d7 2024-04-03T02:25:04.090115220Z [2024-04-03T02:25:04.089+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:25:04.090139535Z 2024-04-03T02:25:04.090715246Z [2024-04-03T02:25:04.090+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:25:04.091243190Z [2024-04-03T02:25:04.091+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:25:04.091252243Z 2024-04-03T02:25:04.094791020Z [2024-04-03T02:25:04.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:25:04.094877649Z [2024-04-03T02:25:04.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:25:04.216603765Z [2024-04-03T02:25:04.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status queued for try_number 1 2024-04-03T02:25:04.216737126Z [2024-04-03T02:25:04.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status success for try_number 1 2024-04-03T02:25:04.233069193Z [2024-04-03T02:25:04.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c18a436-f5e0-430c-8e23-66bc470e0030 2024-04-03T02:25:04.233309486Z [2024-04-03T02:25:04.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:20:00+00:00, map_index=-1, run_start_date=2024-04-03 02:25:03.387340+00:00, run_end_date=2024-04-03 02:25:03.944661+00:00, run_duration=0.557321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:25:01.035704+00:00, queued_by_job_id=1, pid=4645 2024-04-03T02:25:05.417621146Z [2024-04-03T02:25:05.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:25:05.418469346Z [2024-04-03T02:25:05.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:24:00+00:00, run_id=scheduled__2024-04-03T02:24:00+00:00, run_start_date=2024-04-03 02:25:00.951336+00:00, run_end_date=2024-04-03 02:25:05.417874+00:00, run_duration=4.466538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:24:00+00:00, data_interval_end=2024-04-03 02:25:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:25:05.440109053Z [2024-04-03T02:25:05.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:25:00+00:00, run_after=2024-04-03T02:26:00+00:00 2024-04-03T02:25:05.522502526Z [2024-04-03T02:25:05.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:24:00+00:00 exited with status success for try_number 1 2024-04-03T02:25:05.530327466Z [2024-04-03T02:25:05.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:24:00+00:00, map_index=-1, run_start_date=2024-04-03 02:25:03.345753+00:00, run_end_date=2024-04-03 02:25:04.989697+00:00, run_duration=1.643944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:25:01.035704+00:00, queued_by_job_id=1, pid=4644 2024-04-03T02:25:06.570558267Z [2024-04-03T02:25:06.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:25:06.570956007Z [2024-04-03T02:25:06.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:24:00+00:00, run_id=scheduled__2024-04-03T02:24:00+00:00, run_start_date=2024-04-03 02:25:00.952553+00:00, run_end_date=2024-04-03 02:25:06.570572+00:00, run_duration=5.618019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:24:00+00:00, data_interval_end=2024-04-03 02:25:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:25:06.581263501Z [2024-04-03T02:25:06.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:25:00+00:00, run_after=2024-04-03T02:26:00+00:00 2024-04-03T02:25:06.609794346Z [2024-04-03T02:25:06.609+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:25:06.609815324Z 2024-04-03T02:25:06.610105681Z [2024-04-03T02:25:06.609+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:25:06.610694821Z [2024-04-03T02:25:06.610+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:25:06.610708948Z 2024-04-03T02:25:06.613480840Z [2024-04-03T02:25:06.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:25:06.613503756Z [2024-04-03T02:25:06.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:25:06.693529777Z [2024-04-03T02:25:06.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status queued for try_number 1 2024-04-03T02:25:06.693724555Z [2024-04-03T02:25:06.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:24:00+00:00 exited with status success for try_number 1 2024-04-03T02:25:06.694413985Z [2024-04-03T02:25:06.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status success for try_number 1 2024-04-03T02:25:06.702421506Z [2024-04-03T02:25:06.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:24:00+00:00, map_index=-1, run_start_date=2024-04-03 02:25:03.614849+00:00, run_end_date=2024-04-03 02:25:05.880842+00:00, run_duration=2.265993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:25:01.035704+00:00, queued_by_job_id=1, pid=4646 2024-04-03T02:25:06.702683024Z [2024-04-03T02:25:06.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:20:00+00:00, map_index=-1, run_start_date=2024-04-03 02:25:05.812417+00:00, run_end_date=2024-04-03 02:25:06.153875+00:00, run_duration=0.341458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:25:04.091563+00:00, queued_by_job_id=1, pid=4685 2024-04-03T02:25:06.702898786Z [2024-04-03T02:25:06.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13d98286-9377-4cdd-8deb-1b63162e9674 2024-04-03T02:25:08.901459075Z [2024-04-03T02:25:08.900+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:25:08.901496984Z 2024-04-03T02:25:08.901925215Z [2024-04-03T02:25:08.901+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:25:08.903060352Z [2024-04-03T02:25:08.902+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:25:08.903093545Z 2024-04-03T02:25:08.907184955Z [2024-04-03T02:25:08.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:25:08.907448482Z [2024-04-03T02:25:08.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:25:08.957165948Z [2024-04-03T02:25:08.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status queued for try_number 1 2024-04-03T02:25:08.957262676Z [2024-04-03T02:25:08.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status success for try_number 1 2024-04-03T02:25:08.962658949Z [2024-04-03T02:25:08.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7ae2718-fcd5-4d7c-ae12-c35c72e4f447 2024-04-03T02:25:08.962830261Z [2024-04-03T02:25:08.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:20:00+00:00, map_index=0, run_start_date=2024-04-03 02:25:08.255418+00:00, run_end_date=2024-04-03 02:25:08.549099+00:00, run_duration=0.293681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:25:06.611121+00:00, queued_by_job_id=1, pid=4697 2024-04-03T02:25:11.491287439Z [2024-04-03T02:25:11.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:25:11.491325993Z [2024-04-03T02:25:11.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:20:00+00:00, run_id=scheduled__2024-04-03T02:20:00+00:00, run_start_date=2024-04-03 02:25:00.950121+00:00, run_end_date=2024-04-03 02:25:11.486889+00:00, run_duration=10.536768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:20:00+00:00, data_interval_end=2024-04-03 02:25:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:25:11.496565010Z [2024-04-03T02:25:11.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:25:00+00:00, run_after=2024-04-03T02:30:00+00:00 2024-04-03T02:25:11.527338457Z [2024-04-03T02:25:11.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:20:00+00:00 exited with status success for try_number 1 2024-04-03T02:25:11.532156300Z [2024-04-03T02:25:11.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:20:00+00:00, map_index=-1, run_start_date=2024-04-03 02:25:10.619556+00:00, run_end_date=2024-04-03 02:25:11.015880+00:00, run_duration=0.396324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:25:08.904659+00:00, queued_by_job_id=1, pid=4709 2024-04-03T02:26:01.068810989Z [2024-04-03T02:26:01.068+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:26:01.080966687Z [2024-04-03T02:26:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:26:00+00:00, run_after=2024-04-03T02:27:00+00:00 2024-04-03T02:26:01.089708917Z [2024-04-03T02:26:01.089+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:26:01.145382710Z [2024-04-03T02:26:01.145+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:26:01.145407759Z 2024-04-03T02:26:01.145412440Z 2024-04-03T02:26:01.145415683Z 2024-04-03T02:26:01.145595411Z [2024-04-03T02:26:01.145+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:26:01.145765633Z [2024-04-03T02:26:01.145+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:26:01.145914195Z [2024-04-03T02:26:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:26:01.146598962Z [2024-04-03T02:26:01.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:26:01.146619743Z 2024-04-03T02:26:01.146623565Z 2024-04-03T02:26:01.146626829Z 2024-04-03T02:26:01.150986589Z [2024-04-03T02:26:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:26:01.151164013Z [2024-04-03T02:26:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:26:01.151482913Z [2024-04-03T02:26:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:26:01.151691818Z [2024-04-03T02:26:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:26:01.151952043Z [2024-04-03T02:26:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:26:01.152107304Z [2024-04-03T02:26:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:26:01.425706540Z [2024-04-03T02:26:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:24:00+00:00 exited with status queued for try_number 1 2024-04-03T02:26:01.425854280Z [2024-04-03T02:26:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status queued for try_number 1 2024-04-03T02:26:01.426001531Z [2024-04-03T02:26:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status queued for try_number 1 2024-04-03T02:26:01.433018949Z [2024-04-03T02:26:01.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f48b54b-53b9-4dd9-93d4-5cd76fc1c4c0 2024-04-03T02:26:01.433195263Z [2024-04-03T02:26:01.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff7b988a-23c3-45cb-af50-40f45ca5763b 2024-04-03T02:26:01.433360840Z [2024-04-03T02:26:01.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15d35736-1f40-491a-a78c-2cba940c18fd 2024-04-03T02:26:02.927964248Z [2024-04-03T02:26:02.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:26:02.931366028Z [2024-04-03T02:26:02.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:24:00+00:00, run_id=scheduled__2024-04-03T02:24:00+00:00, run_start_date=2024-04-03 02:26:01.099603+00:00, run_end_date=2024-04-03 02:26:02.927866+00:00, run_duration=1.828263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:24:00+00:00, data_interval_end=2024-04-03 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:26:02.960786952Z [2024-04-03T02:26:02.960+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:26:00+00:00, run_after=2024-04-03T02:28:00+00:00 2024-04-03T02:26:03.072999125Z [2024-04-03T02:26:03.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:24:00+00:00 exited with status success for try_number 1 2024-04-03T02:26:03.081517885Z [2024-04-03T02:26:03.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:24:00+00:00, map_index=-1, run_start_date=2024-04-03 02:26:01.961923+00:00, run_end_date=2024-04-03 02:26:02.290441+00:00, run_duration=0.328518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:26:01.147340+00:00, queued_by_job_id=1, pid=4727 2024-04-03T02:26:06.197182921Z [2024-04-03T02:26:06.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:26:06.197281861Z [2024-04-03T02:26:06.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:25:00+00:00, run_id=scheduled__2024-04-03T02:25:00+00:00, run_start_date=2024-04-03 02:26:01.100826+00:00, run_end_date=2024-04-03 02:26:06.196722+00:00, run_duration=5.095896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:25:00+00:00, data_interval_end=2024-04-03 02:26:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:26:06.209153080Z [2024-04-03T02:26:06.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:26:00+00:00, run_after=2024-04-03T02:27:00+00:00 2024-04-03T02:26:06.216461705Z [2024-04-03T02:26:06.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:26:06.216868044Z [2024-04-03T02:26:06.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:25:00+00:00, run_id=scheduled__2024-04-03T02:25:00+00:00, run_start_date=2024-04-03 02:26:01.101856+00:00, run_end_date=2024-04-03 02:26:06.216291+00:00, run_duration=5.114435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:25:00+00:00, data_interval_end=2024-04-03 02:26:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:26:06.228632928Z [2024-04-03T02:26:06.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:26:00+00:00, run_after=2024-04-03T02:27:00+00:00 2024-04-03T02:26:06.266124780Z [2024-04-03T02:26:06.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status success for try_number 1 2024-04-03T02:26:06.266333696Z [2024-04-03T02:26:06.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status success for try_number 1 2024-04-03T02:26:06.272614467Z [2024-04-03T02:26:06.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:25:00+00:00, map_index=-1, run_start_date=2024-04-03 02:26:03.174696+00:00, run_end_date=2024-04-03 02:26:05.348739+00:00, run_duration=2.174043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:26:01.147340+00:00, queued_by_job_id=1, pid=4757 2024-04-03T02:26:06.272835690Z [2024-04-03T02:26:06.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:25:00+00:00, map_index=-1, run_start_date=2024-04-03 02:26:03.386875+00:00, run_end_date=2024-04-03 02:26:05.287691+00:00, run_duration=1.900816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:26:01.147340+00:00, queued_by_job_id=1, pid=4758 2024-04-03T02:26:35.344863371Z [2024-04-03T02:26:35.344+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:27:00.077828554Z [2024-04-03T02:27:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:27:00+00:00, run_after=2024-04-03T02:28:00+00:00 2024-04-03T02:27:00.085788771Z [2024-04-03T02:27:00.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:27:00.190757438Z [2024-04-03T02:27:00.189+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:27:00.190795536Z 2024-04-03T02:27:00.190799108Z 2024-04-03T02:27:00.190802339Z [2024-04-03T02:27:00.189+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:27:00.190805703Z [2024-04-03T02:27:00.189+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:27:00.190810927Z [2024-04-03T02:27:00.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:27:00.190814048Z 2024-04-03T02:27:00.190817088Z 2024-04-03T02:27:00.193396769Z [2024-04-03T02:27:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:27:00.193662705Z [2024-04-03T02:27:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:27:00.193976258Z [2024-04-03T02:27:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:27:00.194160732Z [2024-04-03T02:27:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:27:00.508183268Z [2024-04-03T02:27:00.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:26:00+00:00 exited with status queued for try_number 1 2024-04-03T02:27:00.508436989Z [2024-04-03T02:27:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:26:00+00:00 exited with status queued for try_number 1 2024-04-03T02:27:00.521674092Z [2024-04-03T02:27:00.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb42f440-1d18-4e55-b56e-055d204f1efa 2024-04-03T02:27:00.522344032Z [2024-04-03T02:27:00.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e95f44f-84fa-4a8d-ba0a-25606af609c3 2024-04-03T02:27:04.413218982Z [2024-04-03T02:27:04.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:27:04.413431970Z [2024-04-03T02:27:04.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:26:00+00:00, run_id=scheduled__2024-04-03T02:26:00+00:00, run_start_date=2024-04-03 02:27:00.096367+00:00, run_end_date=2024-04-03 02:27:04.413031+00:00, run_duration=4.316664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:26:00+00:00, data_interval_end=2024-04-03 02:27:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:27:04.430709275Z [2024-04-03T02:27:04.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:27:00+00:00, run_after=2024-04-03T02:28:00+00:00 2024-04-03T02:27:04.480153856Z [2024-04-03T02:27:04.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:26:00+00:00 exited with status success for try_number 1 2024-04-03T02:27:04.486026662Z [2024-04-03T02:27:04.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:26:00+00:00, map_index=-1, run_start_date=2024-04-03 02:27:02.354280+00:00, run_end_date=2024-04-03 02:27:03.753910+00:00, run_duration=1.39963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:27:00.191269+00:00, queued_by_job_id=1, pid=4812 2024-04-03T02:27:05.529021596Z [2024-04-03T02:27:05.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:27:05.529167562Z [2024-04-03T02:27:05.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:26:00+00:00, run_id=scheduled__2024-04-03T02:26:00+00:00, run_start_date=2024-04-03 02:27:00.097709+00:00, run_end_date=2024-04-03 02:27:05.528870+00:00, run_duration=5.431161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:26:00+00:00, data_interval_end=2024-04-03 02:27:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:27:05.539568194Z [2024-04-03T02:27:05.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:27:00+00:00, run_after=2024-04-03T02:28:00+00:00 2024-04-03T02:27:05.580038898Z [2024-04-03T02:27:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:26:00+00:00 exited with status success for try_number 1 2024-04-03T02:27:05.585416721Z [2024-04-03T02:27:05.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:26:00+00:00, map_index=-1, run_start_date=2024-04-03 02:27:02.323795+00:00, run_end_date=2024-04-03 02:27:04.723298+00:00, run_duration=2.399503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:27:00.191269+00:00, queued_by_job_id=1, pid=4811 2024-04-03T02:28:00.990692877Z [2024-04-03T02:28:00.990+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:28:01.009242292Z [2024-04-03T02:28:01.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:28:00+00:00, run_after=2024-04-03T02:29:00+00:00 2024-04-03T02:28:01.016560254Z [2024-04-03T02:28:01.016+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:28:01.089902618Z [2024-04-03T02:28:01.089+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:28:01.089929184Z 2024-04-03T02:28:01.089933458Z 2024-04-03T02:28:01.089936804Z 2024-04-03T02:28:01.090118918Z [2024-04-03T02:28:01.089+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:28:01.090343390Z [2024-04-03T02:28:01.090+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:28:01.090519714Z [2024-04-03T02:28:01.090+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:28:01.091156909Z [2024-04-03T02:28:01.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:28:01.091169348Z 2024-04-03T02:28:01.091172942Z 2024-04-03T02:28:01.091176229Z 2024-04-03T02:28:01.094743394Z [2024-04-03T02:28:01.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:28:01.098030051Z [2024-04-03T02:28:01.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:28:01.098399871Z [2024-04-03T02:28:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:28:01.098627940Z [2024-04-03T02:28:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:28:01.098951656Z [2024-04-03T02:28:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:28:01.099277011Z [2024-04-03T02:28:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:28:01.388937916Z [2024-04-03T02:28:01.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:26:00+00:00 exited with status queued for try_number 1 2024-04-03T02:28:01.391249491Z [2024-04-03T02:28:01.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:27:00+00:00 exited with status queued for try_number 1 2024-04-03T02:28:01.391514323Z [2024-04-03T02:28:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:27:00+00:00 exited with status queued for try_number 1 2024-04-03T02:28:01.784762654Z [2024-04-03T02:28:01.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ddcb559-9ff0-43fa-a234-fa080ff7039d 2024-04-03T02:28:01.784938365Z [2024-04-03T02:28:01.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84c0338a-5fe7-4cea-a8c6-4ee051102062 2024-04-03T02:28:01.785087328Z [2024-04-03T02:28:01.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fd1aa9c-f9e8-46c6-a761-d533dff7127c 2024-04-03T02:28:02.615747423Z [2024-04-03T02:28:02.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:28:02.616156999Z [2024-04-03T02:28:02.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:26:00+00:00, run_id=scheduled__2024-04-03T02:26:00+00:00, run_start_date=2024-04-03 02:28:01.027860+00:00, run_end_date=2024-04-03 02:28:02.615799+00:00, run_duration=1.587939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:26:00+00:00, data_interval_end=2024-04-03 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:28:02.624826330Z [2024-04-03T02:28:02.624+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:28:00+00:00, run_after=2024-04-03T02:30:00+00:00 2024-04-03T02:28:03.796192203Z [2024-04-03T02:28:03.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:26:00+00:00 exited with status success for try_number 1 2024-04-03T02:28:03.804972581Z [2024-04-03T02:28:03.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:26:00+00:00, map_index=-1, run_start_date=2024-04-03 02:28:02.173329+00:00, run_end_date=2024-04-03 02:28:02.561865+00:00, run_duration=0.388536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:28:01.091867+00:00, queued_by_job_id=1, pid=4846 2024-04-03T02:28:06.936390523Z [2024-04-03T02:28:06.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:28:06.936831721Z [2024-04-03T02:28:06.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:27:00+00:00, run_id=scheduled__2024-04-03T02:27:00+00:00, run_start_date=2024-04-03 02:28:01.029151+00:00, run_end_date=2024-04-03 02:28:06.936248+00:00, run_duration=5.907097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:27:00+00:00, data_interval_end=2024-04-03 02:28:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:28:06.947107458Z [2024-04-03T02:28:06.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:28:00+00:00, run_after=2024-04-03T02:29:00+00:00 2024-04-03T02:28:06.960294833Z [2024-04-03T02:28:06.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:28:06.961043503Z [2024-04-03T02:28:06.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:27:00+00:00, run_id=scheduled__2024-04-03T02:27:00+00:00, run_start_date=2024-04-03 02:28:01.030752+00:00, run_end_date=2024-04-03 02:28:06.960480+00:00, run_duration=5.929728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:27:00+00:00, data_interval_end=2024-04-03 02:28:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:28:06.976182523Z [2024-04-03T02:28:06.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:28:00+00:00, run_after=2024-04-03T02:29:00+00:00 2024-04-03T02:28:07.044158948Z [2024-04-03T02:28:07.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:27:00+00:00 exited with status success for try_number 1 2024-04-03T02:28:07.044528652Z [2024-04-03T02:28:07.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:27:00+00:00 exited with status success for try_number 1 2024-04-03T02:28:07.055660895Z [2024-04-03T02:28:07.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:27:00+00:00, map_index=-1, run_start_date=2024-04-03 02:28:03.914438+00:00, run_end_date=2024-04-03 02:28:06.373074+00:00, run_duration=2.458636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:28:01.091867+00:00, queued_by_job_id=1, pid=4877 2024-04-03T02:28:07.056062230Z [2024-04-03T02:28:07.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:27:00+00:00, map_index=-1, run_start_date=2024-04-03 02:28:03.860538+00:00, run_end_date=2024-04-03 02:28:06.785958+00:00, run_duration=2.92542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:28:01.091867+00:00, queued_by_job_id=1, pid=4876 2024-04-03T02:29:00.980541086Z [2024-04-03T02:29:00.979+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:29:00.995174612Z [2024-04-03T02:29:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:29:00+00:00, run_after=2024-04-03T02:30:00+00:00 2024-04-03T02:29:01.086942737Z [2024-04-03T02:29:01.086+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:29:01.086995130Z 2024-04-03T02:29:01.087005201Z 2024-04-03T02:29:01.087656701Z [2024-04-03T02:29:01.087+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:29:01.088241925Z [2024-04-03T02:29:01.087+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:29:01.089807195Z [2024-04-03T02:29:01.089+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:29:01.089834011Z 2024-04-03T02:29:01.089844193Z 2024-04-03T02:29:01.097491016Z [2024-04-03T02:29:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:29:01.098047270Z [2024-04-03T02:29:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:29:01.098647409Z [2024-04-03T02:29:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:29:01.098942563Z [2024-04-03T02:29:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:29:01.409014464Z [2024-04-03T02:29:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:28:00+00:00 exited with status queued for try_number 1 2024-04-03T02:29:01.409045367Z [2024-04-03T02:29:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:28:00+00:00 exited with status queued for try_number 1 2024-04-03T02:29:01.441693252Z [2024-04-03T02:29:01.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ebf14e0-a037-40d6-aa3e-c2ea09d49eb7 2024-04-03T02:29:01.441729835Z [2024-04-03T02:29:01.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to deb7c393-2ba5-45e5-a4bf-5c84d15b358e 2024-04-03T02:29:06.456584407Z [2024-04-03T02:29:06.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:29:06.456714641Z [2024-04-03T02:29:06.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:28:00+00:00, run_id=scheduled__2024-04-03T02:28:00+00:00, run_start_date=2024-04-03 02:29:01.008397+00:00, run_end_date=2024-04-03 02:29:06.456292+00:00, run_duration=5.447895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:28:00+00:00, data_interval_end=2024-04-03 02:29:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:29:06.475451461Z [2024-04-03T02:29:06.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:29:00+00:00, run_after=2024-04-03T02:30:00+00:00 2024-04-03T02:29:06.498873296Z [2024-04-03T02:29:06.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:29:06.500616962Z [2024-04-03T02:29:06.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:28:00+00:00, run_id=scheduled__2024-04-03T02:28:00+00:00, run_start_date=2024-04-03 02:29:01.009781+00:00, run_end_date=2024-04-03 02:29:06.498206+00:00, run_duration=5.488425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:28:00+00:00, data_interval_end=2024-04-03 02:29:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:29:06.519828420Z [2024-04-03T02:29:06.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:29:00+00:00, run_after=2024-04-03T02:30:00+00:00 2024-04-03T02:29:06.579292467Z [2024-04-03T02:29:06.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:28:00+00:00 exited with status success for try_number 1 2024-04-03T02:29:06.579318239Z [2024-04-03T02:29:06.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:28:00+00:00 exited with status success for try_number 1 2024-04-03T02:29:06.584769715Z [2024-04-03T02:29:06.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:28:00+00:00, map_index=-1, run_start_date=2024-04-03 02:29:03.414757+00:00, run_end_date=2024-04-03 02:29:05.419812+00:00, run_duration=2.005055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:29:01.091362+00:00, queued_by_job_id=1, pid=4931 2024-04-03T02:29:06.584930516Z [2024-04-03T02:29:06.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:28:00+00:00, map_index=-1, run_start_date=2024-04-03 02:29:03.388707+00:00, run_end_date=2024-04-03 02:29:05.734282+00:00, run_duration=2.345575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:29:01.091362+00:00, queued_by_job_id=1, pid=4932 2024-04-03T02:30:00.823581356Z [2024-04-03T02:30:00.823+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:30:00.847512995Z [2024-04-03T02:30:00.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:30:00+00:00, run_after=2024-04-03T02:31:00+00:00 2024-04-03T02:30:00.868374608Z [2024-04-03T02:30:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:30:00+00:00, run_after=2024-04-03T02:35:00+00:00 2024-04-03T02:30:00.875853227Z [2024-04-03T02:30:00.875+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:30:00.961368309Z [2024-04-03T02:30:00.961+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T02:30:00.961438649Z 2024-04-03T02:30:00.961442926Z 2024-04-03T02:30:00.961446660Z 2024-04-03T02:30:00.961450608Z 2024-04-03T02:30:00.962729133Z [2024-04-03T02:30:00.962+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:30:00.963012306Z [2024-04-03T02:30:00.962+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:30:00.965186444Z [2024-04-03T02:30:00.963+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:30:00.965448799Z [2024-04-03T02:30:00.965+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:30:00.966134585Z [2024-04-03T02:30:00.965+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:30:00.966145848Z 2024-04-03T02:30:00.966150071Z 2024-04-03T02:30:00.966153604Z 2024-04-03T02:30:00.966156996Z 2024-04-03T02:30:00.970393662Z [2024-04-03T02:30:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:30:00.970737798Z [2024-04-03T02:30:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:30:00.971204875Z [2024-04-03T02:30:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:30:00.971790177Z [2024-04-03T02:30:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:30:00.972146286Z [2024-04-03T02:30:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:30:00.972371030Z [2024-04-03T02:30:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:30:00.972701459Z [2024-04-03T02:30:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:30:00.972925150Z [2024-04-03T02:30:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:30:01.425789667Z [2024-04-03T02:30:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status queued for try_number 1 2024-04-03T02:30:01.433323438Z [2024-04-03T02:30:01.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:28:00+00:00 exited with status queued for try_number 1 2024-04-03T02:30:01.433452826Z [2024-04-03T02:30:01.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:29:00+00:00 exited with status queued for try_number 1 2024-04-03T02:30:01.433548423Z [2024-04-03T02:30:01.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:29:00+00:00 exited with status queued for try_number 1 2024-04-03T02:30:01.461185512Z [2024-04-03T02:30:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d3aa5c6-44b6-4f5f-ae70-8e255008eae3 2024-04-03T02:30:01.461424463Z [2024-04-03T02:30:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to d07dbf27-9c41-4905-a477-9899e2ded314 2024-04-03T02:30:01.461550566Z [2024-04-03T02:30:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3342858-82ac-4c5a-91c9-1c2defef7ce0 2024-04-03T02:30:01.461667679Z [2024-04-03T02:30:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28480d1a-25c3-4e4c-ac07-bd83446c9c4e 2024-04-03T02:30:02.885037277Z [2024-04-03T02:30:02.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:30:02.885356864Z [2024-04-03T02:30:02.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:28:00+00:00, run_id=scheduled__2024-04-03T02:28:00+00:00, run_start_date=2024-04-03 02:30:00.889043+00:00, run_end_date=2024-04-03 02:30:02.885016+00:00, run_duration=1.995973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:28:00+00:00, data_interval_end=2024-04-03 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:30:02.896851259Z [2024-04-03T02:30:02.896+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:30:00+00:00, run_after=2024-04-03T02:32:00+00:00 2024-04-03T02:30:02.961146783Z [2024-04-03T02:30:02.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:28:00+00:00 exited with status success for try_number 1 2024-04-03T02:30:02.967484117Z [2024-04-03T02:30:02.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:28:00+00:00, map_index=-1, run_start_date=2024-04-03 02:30:02.155688+00:00, run_end_date=2024-04-03 02:30:02.569025+00:00, run_duration=0.413337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:30:00.967162+00:00, queued_by_job_id=1, pid=4968 2024-04-03T02:30:05.027191261Z [2024-04-03T02:30:05.026+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:30:05.027236704Z 2024-04-03T02:30:05.027241175Z [2024-04-03T02:30:05.027+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:30:05.027785882Z [2024-04-03T02:30:05.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:30:05.027793138Z 2024-04-03T02:30:05.030523406Z [2024-04-03T02:30:05.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:30:05.030655938Z [2024-04-03T02:30:05.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:30:05.078766045Z [2024-04-03T02:30:05.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status queued for try_number 1 2024-04-03T02:30:05.078884562Z [2024-04-03T02:30:05.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status success for try_number 1 2024-04-03T02:30:05.084692605Z [2024-04-03T02:30:05.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf980474-f80a-489b-832e-1c1a2fabeb2b 2024-04-03T02:30:05.084857009Z [2024-04-03T02:30:05.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:25:00+00:00, map_index=-1, run_start_date=2024-04-03 02:30:03.993688+00:00, run_end_date=2024-04-03 02:30:04.621104+00:00, run_duration=0.627416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:30:00.967162+00:00, queued_by_job_id=1, pid=5010 2024-04-03T02:30:06.239509235Z [2024-04-03T02:30:06.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:30:06.240249820Z [2024-04-03T02:30:06.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:29:00+00:00, run_id=scheduled__2024-04-03T02:29:00+00:00, run_start_date=2024-04-03 02:30:00.890041+00:00, run_end_date=2024-04-03 02:30:06.239886+00:00, run_duration=5.349845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:29:00+00:00, data_interval_end=2024-04-03 02:30:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:30:06.249128494Z [2024-04-03T02:30:06.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:30:00+00:00, run_after=2024-04-03T02:31:00+00:00 2024-04-03T02:30:06.255656507Z [2024-04-03T02:30:06.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:30:06.256018840Z [2024-04-03T02:30:06.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:29:00+00:00, run_id=scheduled__2024-04-03T02:29:00+00:00, run_start_date=2024-04-03 02:30:00.891034+00:00, run_end_date=2024-04-03 02:30:06.255751+00:00, run_duration=5.364717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:29:00+00:00, data_interval_end=2024-04-03 02:30:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:30:06.265118763Z [2024-04-03T02:30:06.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:30:00+00:00, run_after=2024-04-03T02:31:00+00:00 2024-04-03T02:30:06.312625861Z [2024-04-03T02:30:06.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:29:00+00:00 exited with status success for try_number 1 2024-04-03T02:30:06.313109086Z [2024-04-03T02:30:06.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:29:00+00:00 exited with status success for try_number 1 2024-04-03T02:30:06.319763672Z [2024-04-03T02:30:06.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:29:00+00:00, map_index=-1, run_start_date=2024-04-03 02:30:03.903391+00:00, run_end_date=2024-04-03 02:30:05.816285+00:00, run_duration=1.912894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:30:00.967162+00:00, queued_by_job_id=1, pid=5008 2024-04-03T02:30:06.320108430Z [2024-04-03T02:30:06.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:29:00+00:00, map_index=-1, run_start_date=2024-04-03 02:30:03.993405+00:00, run_end_date=2024-04-03 02:30:05.474346+00:00, run_duration=1.480941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:30:00.967162+00:00, queued_by_job_id=1, pid=5009 2024-04-03T02:30:07.420456074Z [2024-04-03T02:30:07.419+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:30:07.420513856Z 2024-04-03T02:30:07.420526599Z [2024-04-03T02:30:07.419+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:30:07.420540228Z [2024-04-03T02:30:07.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:30:07.420549573Z 2024-04-03T02:30:07.425369081Z [2024-04-03T02:30:07.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:30:07.425401899Z [2024-04-03T02:30:07.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:30:07.547099472Z [2024-04-03T02:30:07.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status queued for try_number 1 2024-04-03T02:30:07.547145576Z [2024-04-03T02:30:07.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status success for try_number 1 2024-04-03T02:30:07.553849412Z [2024-04-03T02:30:07.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16f63eea-a595-471b-96ab-9da985e0ff00 2024-04-03T02:30:07.554061759Z [2024-04-03T02:30:07.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:25:00+00:00, map_index=-1, run_start_date=2024-04-03 02:30:06.812073+00:00, run_end_date=2024-04-03 02:30:07.181135+00:00, run_duration=0.369062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:30:05.028077+00:00, queued_by_job_id=1, pid=5049 2024-04-03T02:30:10.158220527Z [2024-04-03T02:30:10.154+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:30:10.158263588Z 2024-04-03T02:30:10.158272335Z [2024-04-03T02:30:10.154+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:30:10.158278181Z [2024-04-03T02:30:10.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:30:10.158282493Z 2024-04-03T02:30:10.162216034Z [2024-04-03T02:30:10.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:30:10.162236330Z [2024-04-03T02:30:10.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:30:10.262511342Z [2024-04-03T02:30:10.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status queued for try_number 1 2024-04-03T02:30:10.262531504Z [2024-04-03T02:30:10.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status success for try_number 1 2024-04-03T02:30:10.275148455Z [2024-04-03T02:30:10.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89b9b89f-2d5e-40ea-b11e-62200a74854b 2024-04-03T02:30:10.275470464Z [2024-04-03T02:30:10.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:25:00+00:00, map_index=0, run_start_date=2024-04-03 02:30:09.209310+00:00, run_end_date=2024-04-03 02:30:09.517840+00:00, run_duration=0.30853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:30:07.420616+00:00, queued_by_job_id=1, pid=5061 2024-04-03T02:30:13.658851038Z [2024-04-03T02:30:13.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:30:13.659362003Z [2024-04-03T02:30:13.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:25:00+00:00, run_id=scheduled__2024-04-03T02:25:00+00:00, run_start_date=2024-04-03 02:30:00.887449+00:00, run_end_date=2024-04-03 02:30:13.658962+00:00, run_duration=12.771513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:25:00+00:00, data_interval_end=2024-04-03 02:30:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:30:13.666434886Z [2024-04-03T02:30:13.666+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:30:00+00:00, run_after=2024-04-03T02:35:00+00:00 2024-04-03T02:30:13.695454453Z [2024-04-03T02:30:13.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:25:00+00:00 exited with status success for try_number 1 2024-04-03T02:30:13.704796706Z [2024-04-03T02:30:13.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:25:00+00:00, map_index=-1, run_start_date=2024-04-03 02:30:12.248034+00:00, run_end_date=2024-04-03 02:30:12.831999+00:00, run_duration=0.583965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:30:10.155906+00:00, queued_by_job_id=1, pid=5073 2024-04-03T02:31:00.710186313Z [2024-04-03T02:31:00.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:31:00+00:00, run_after=2024-04-03T02:32:00+00:00 2024-04-03T02:31:00.719068585Z [2024-04-03T02:31:00.718+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:31:00.813389552Z [2024-04-03T02:31:00.811+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:31:00.813406859Z 2024-04-03T02:31:00.813410263Z 2024-04-03T02:31:00.813413565Z [2024-04-03T02:31:00.811+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:31:00.813416997Z [2024-04-03T02:31:00.811+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:31:00.813421038Z [2024-04-03T02:31:00.812+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:31:00.813424063Z 2024-04-03T02:31:00.813427171Z 2024-04-03T02:31:00.819383317Z [2024-04-03T02:31:00.818+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:31:00.819399867Z [2024-04-03T02:31:00.818+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:31:00.819403671Z [2024-04-03T02:31:00.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:31:00.819425849Z [2024-04-03T02:31:00.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:31:01.044847581Z [2024-04-03T02:31:01.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status queued for try_number 1 2024-04-03T02:31:01.044924680Z [2024-04-03T02:31:01.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status queued for try_number 1 2024-04-03T02:31:01.052237893Z [2024-04-03T02:31:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7259691-448c-4d6b-a604-19a5a4bffbc4 2024-04-03T02:31:01.052280195Z [2024-04-03T02:31:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7982616f-baf5-4d47-a797-57e18d2f7116 2024-04-03T02:31:04.017223686Z [2024-04-03T02:31:04.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:31:04.017690308Z [2024-04-03T02:31:04.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:30:00+00:00, run_id=scheduled__2024-04-03T02:30:00+00:00, run_start_date=2024-04-03 02:31:00.734894+00:00, run_end_date=2024-04-03 02:31:04.017146+00:00, run_duration=3.282252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:30:00+00:00, data_interval_end=2024-04-03 02:31:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:31:04.035762992Z [2024-04-03T02:31:04.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:31:00+00:00, run_after=2024-04-03T02:32:00+00:00 2024-04-03T02:31:04.700645381Z [2024-04-03T02:31:04.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:31:04.701110934Z [2024-04-03T02:31:04.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:30:00+00:00, run_id=scheduled__2024-04-03T02:30:00+00:00, run_start_date=2024-04-03 02:31:00.736577+00:00, run_end_date=2024-04-03 02:31:04.700490+00:00, run_duration=3.963913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:30:00+00:00, data_interval_end=2024-04-03 02:31:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:31:04.709950041Z [2024-04-03T02:31:04.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:31:00+00:00, run_after=2024-04-03T02:32:00+00:00 2024-04-03T02:31:04.748142126Z [2024-04-03T02:31:04.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status success for try_number 1 2024-04-03T02:31:04.748380616Z [2024-04-03T02:31:04.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status success for try_number 1 2024-04-03T02:31:04.756545487Z [2024-04-03T02:31:04.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:30:00+00:00, map_index=-1, run_start_date=2024-04-03 02:31:02.650125+00:00, run_end_date=2024-04-03 02:31:03.967927+00:00, run_duration=1.317802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:31:00.815067+00:00, queued_by_job_id=1, pid=5109 2024-04-03T02:31:04.756940976Z [2024-04-03T02:31:04.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:30:00+00:00, map_index=-1, run_start_date=2024-04-03 02:31:02.700925+00:00, run_end_date=2024-04-03 02:31:04.393128+00:00, run_duration=1.692203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:31:00.815067+00:00, queued_by_job_id=1, pid=5110 2024-04-03T02:31:35.420574330Z [2024-04-03T02:31:35.419+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:32:00.487432156Z [2024-04-03T02:32:00.487+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:32:00.506924396Z [2024-04-03T02:32:00.506+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:32:00+00:00, run_after=2024-04-03T02:33:00+00:00 2024-04-03T02:32:00.515110597Z [2024-04-03T02:32:00.514+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:32:00.573304573Z [2024-04-03T02:32:00.572+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:32:00.573330598Z 2024-04-03T02:32:00.573334933Z 2024-04-03T02:32:00.573338383Z 2024-04-03T02:32:00.573397361Z [2024-04-03T02:32:00.573+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:32:00.573569254Z [2024-04-03T02:32:00.573+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:32:00.573682567Z [2024-04-03T02:32:00.573+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:32:00.574242933Z [2024-04-03T02:32:00.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:32:00.574269233Z 2024-04-03T02:32:00.574272846Z 2024-04-03T02:32:00.574283627Z 2024-04-03T02:32:00.577593419Z [2024-04-03T02:32:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:32:00.577804263Z [2024-04-03T02:32:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:32:00.578048832Z [2024-04-03T02:32:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:32:00.578172742Z [2024-04-03T02:32:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:32:00.578400030Z [2024-04-03T02:32:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:32:00.578516346Z [2024-04-03T02:32:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:32:00.894811710Z [2024-04-03T02:32:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status queued for try_number 1 2024-04-03T02:32:00.894947742Z [2024-04-03T02:32:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:31:00+00:00 exited with status queued for try_number 1 2024-04-03T02:32:00.895028768Z [2024-04-03T02:32:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:31:00+00:00 exited with status queued for try_number 1 2024-04-03T02:32:00.903800388Z [2024-04-03T02:32:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41d2132b-32f3-4968-98d2-b85784e55094 2024-04-03T02:32:00.904138967Z [2024-04-03T02:32:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to db257064-a897-4f31-9050-64998dfd0144 2024-04-03T02:32:00.904316660Z [2024-04-03T02:32:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cc245ba-f7d4-4074-8782-9a152743a1f5 2024-04-03T02:32:02.087859962Z [2024-04-03T02:32:02.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:32:02.088369564Z [2024-04-03T02:32:02.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:30:00+00:00, run_id=scheduled__2024-04-03T02:30:00+00:00, run_start_date=2024-04-03 02:32:00.526310+00:00, run_end_date=2024-04-03 02:32:02.087912+00:00, run_duration=1.561602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:30:00+00:00, data_interval_end=2024-04-03 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:32:02.099753726Z [2024-04-03T02:32:02.099+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:32:00+00:00, run_after=2024-04-03T02:34:00+00:00 2024-04-03T02:32:02.150655429Z [2024-04-03T02:32:02.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status success for try_number 1 2024-04-03T02:32:02.159695211Z [2024-04-03T02:32:02.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:30:00+00:00, map_index=-1, run_start_date=2024-04-03 02:32:01.656915+00:00, run_end_date=2024-04-03 02:32:01.971709+00:00, run_duration=0.314794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:32:00.575010+00:00, queued_by_job_id=1, pid=5146 2024-04-03T02:32:05.411950956Z [2024-04-03T02:32:05.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:32:05.412376992Z [2024-04-03T02:32:05.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:31:00+00:00, run_id=scheduled__2024-04-03T02:31:00+00:00, run_start_date=2024-04-03 02:32:00.527611+00:00, run_end_date=2024-04-03 02:32:05.411816+00:00, run_duration=4.884205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:31:00+00:00, data_interval_end=2024-04-03 02:32:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:32:05.422190094Z [2024-04-03T02:32:05.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:32:00+00:00, run_after=2024-04-03T02:33:00+00:00 2024-04-03T02:32:05.457839948Z [2024-04-03T02:32:05.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:31:00+00:00 exited with status success for try_number 1 2024-04-03T02:32:05.462455094Z [2024-04-03T02:32:05.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:31:00+00:00, map_index=-1, run_start_date=2024-04-03 02:32:02.954792+00:00, run_end_date=2024-04-03 02:32:04.726035+00:00, run_duration=1.771243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:32:00.575010+00:00, queued_by_job_id=1, pid=5177 2024-04-03T02:32:05.959620686Z [2024-04-03T02:32:05.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:32:05.960305573Z [2024-04-03T02:32:05.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:31:00+00:00, run_id=scheduled__2024-04-03T02:31:00+00:00, run_start_date=2024-04-03 02:32:00.528599+00:00, run_end_date=2024-04-03 02:32:05.959497+00:00, run_duration=5.430898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:31:00+00:00, data_interval_end=2024-04-03 02:32:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:32:05.972543361Z [2024-04-03T02:32:05.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:32:00+00:00, run_after=2024-04-03T02:33:00+00:00 2024-04-03T02:32:05.998898719Z [2024-04-03T02:32:05.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:31:00+00:00 exited with status success for try_number 1 2024-04-03T02:32:06.007097130Z [2024-04-03T02:32:06.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:31:00+00:00, map_index=-1, run_start_date=2024-04-03 02:32:02.677946+00:00, run_end_date=2024-04-03 02:32:05.577391+00:00, run_duration=2.899445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:32:00.575010+00:00, queued_by_job_id=1, pid=5174 2024-04-03T02:33:01.005268000Z [2024-04-03T02:33:01.004+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:33:00+00:00, run_after=2024-04-03T02:34:00+00:00 2024-04-03T02:33:01.013478339Z [2024-04-03T02:33:01.013+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:33:01.077908727Z [2024-04-03T02:33:01.077+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:33:01.077938573Z 2024-04-03T02:33:01.077943824Z 2024-04-03T02:33:01.078155210Z [2024-04-03T02:33:01.077+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:33:01.078362747Z [2024-04-03T02:33:01.078+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:33:01.078996197Z [2024-04-03T02:33:01.078+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:33:01.079023016Z 2024-04-03T02:33:01.079026661Z 2024-04-03T02:33:01.081972370Z [2024-04-03T02:33:01.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:33:01.082155339Z [2024-04-03T02:33:01.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:33:01.082406333Z [2024-04-03T02:33:01.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:33:01.082737018Z [2024-04-03T02:33:01.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:33:01.265669581Z [2024-04-03T02:33:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:32:00+00:00 exited with status queued for try_number 1 2024-04-03T02:33:01.265882227Z [2024-04-03T02:33:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:32:00+00:00 exited with status queued for try_number 1 2024-04-03T02:33:01.274529812Z [2024-04-03T02:33:01.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7d5baf3-649e-4ed5-9171-eff774515669 2024-04-03T02:33:01.274964353Z [2024-04-03T02:33:01.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1139cc2e-bfc5-4da3-9539-91c8b6923f3b 2024-04-03T02:33:04.707531837Z [2024-04-03T02:33:04.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:33:04.708047998Z [2024-04-03T02:33:04.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:32:00+00:00, run_id=scheduled__2024-04-03T02:32:00+00:00, run_start_date=2024-04-03 02:33:01.026921+00:00, run_end_date=2024-04-03 02:33:04.707400+00:00, run_duration=3.680479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:32:00+00:00, data_interval_end=2024-04-03 02:33:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:33:04.717042684Z [2024-04-03T02:33:04.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:33:00+00:00, run_after=2024-04-03T02:34:00+00:00 2024-04-03T02:33:04.755634225Z [2024-04-03T02:33:04.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:32:00+00:00 exited with status success for try_number 1 2024-04-03T02:33:04.760806501Z [2024-04-03T02:33:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:32:00+00:00, map_index=-1, run_start_date=2024-04-03 02:33:03.073682+00:00, run_end_date=2024-04-03 02:33:04.491006+00:00, run_duration=1.417324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:33:01.079678+00:00, queued_by_job_id=1, pid=5232 2024-04-03T02:33:05.809464525Z [2024-04-03T02:33:05.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:33:05.809807573Z [2024-04-03T02:33:05.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:32:00+00:00, run_id=scheduled__2024-04-03T02:32:00+00:00, run_start_date=2024-04-03 02:33:01.028717+00:00, run_end_date=2024-04-03 02:33:05.809477+00:00, run_duration=4.78076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:32:00+00:00, data_interval_end=2024-04-03 02:33:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:33:05.818132574Z [2024-04-03T02:33:05.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:33:00+00:00, run_after=2024-04-03T02:34:00+00:00 2024-04-03T02:33:05.842690745Z [2024-04-03T02:33:05.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:32:00+00:00 exited with status success for try_number 1 2024-04-03T02:33:05.847480405Z [2024-04-03T02:33:05.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:32:00+00:00, map_index=-1, run_start_date=2024-04-03 02:33:03.001654+00:00, run_end_date=2024-04-03 02:33:04.701767+00:00, run_duration=1.700113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:33:01.079678+00:00, queued_by_job_id=1, pid=5231 2024-04-03T02:34:00.817900993Z [2024-04-03T02:34:00.817+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:34:00.845589647Z [2024-04-03T02:34:00.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:34:00+00:00, run_after=2024-04-03T02:35:00+00:00 2024-04-03T02:34:00.855843900Z [2024-04-03T02:34:00.855+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:34:00.944220439Z [2024-04-03T02:34:00.943+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:34:00.944237058Z 2024-04-03T02:34:00.944241105Z 2024-04-03T02:34:00.944244568Z 2024-04-03T02:34:00.944313072Z [2024-04-03T02:34:00.944+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:34:00.944395039Z [2024-04-03T02:34:00.944+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:34:00.944546149Z [2024-04-03T02:34:00.944+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:34:00.945173754Z [2024-04-03T02:34:00.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:34:00.945185111Z 2024-04-03T02:34:00.945188827Z 2024-04-03T02:34:00.945192099Z 2024-04-03T02:34:00.949052988Z [2024-04-03T02:34:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:34:00.949174389Z [2024-04-03T02:34:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:34:00.949370927Z [2024-04-03T02:34:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:34:00.949463867Z [2024-04-03T02:34:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:34:00.949614046Z [2024-04-03T02:34:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:34:00.949682119Z [2024-04-03T02:34:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:34:01.343666183Z [2024-04-03T02:34:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:32:00+00:00 exited with status queued for try_number 1 2024-04-03T02:34:01.347315787Z [2024-04-03T02:34:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:33:00+00:00 exited with status queued for try_number 1 2024-04-03T02:34:01.347660458Z [2024-04-03T02:34:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:33:00+00:00 exited with status queued for try_number 1 2024-04-03T02:34:01.367602147Z [2024-04-03T02:34:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6038d89a-94cf-4edc-a3f4-8b19c80fad92 2024-04-03T02:34:01.367974674Z [2024-04-03T02:34:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to 126db79b-4929-47a5-9820-ff178cabd8d4 2024-04-03T02:34:01.368321850Z [2024-04-03T02:34:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 908b737f-265a-4e25-adc8-b4ea87d98887 2024-04-03T02:34:02.521608474Z [2024-04-03T02:34:02.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:34:02.522219901Z [2024-04-03T02:34:02.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:32:00+00:00, run_id=scheduled__2024-04-03T02:32:00+00:00, run_start_date=2024-04-03 02:34:00.865061+00:00, run_end_date=2024-04-03 02:34:02.521723+00:00, run_duration=1.656662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:32:00+00:00, data_interval_end=2024-04-03 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:34:02.529913966Z [2024-04-03T02:34:02.529+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:34:00+00:00, run_after=2024-04-03T02:36:00+00:00 2024-04-03T02:34:02.573699914Z [2024-04-03T02:34:02.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:32:00+00:00 exited with status success for try_number 1 2024-04-03T02:34:02.579210385Z [2024-04-03T02:34:02.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:32:00+00:00, map_index=-1, run_start_date=2024-04-03 02:34:01.855866+00:00, run_end_date=2024-04-03 02:34:02.185310+00:00, run_duration=0.329444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:34:00.945973+00:00, queued_by_job_id=1, pid=5267 2024-04-03T02:34:06.194321894Z [2024-04-03T02:34:06.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:34:06.194934827Z [2024-04-03T02:34:06.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:33:00+00:00, run_id=scheduled__2024-04-03T02:33:00+00:00, run_start_date=2024-04-03 02:34:00.866391+00:00, run_end_date=2024-04-03 02:34:06.194572+00:00, run_duration=5.328181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:33:00+00:00, data_interval_end=2024-04-03 02:34:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:34:06.204665535Z [2024-04-03T02:34:06.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:34:00+00:00, run_after=2024-04-03T02:35:00+00:00 2024-04-03T02:34:06.212505640Z [2024-04-03T02:34:06.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:34:06.212914233Z [2024-04-03T02:34:06.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:33:00+00:00, run_id=scheduled__2024-04-03T02:33:00+00:00, run_start_date=2024-04-03 02:34:00.867482+00:00, run_end_date=2024-04-03 02:34:06.212613+00:00, run_duration=5.345131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:33:00+00:00, data_interval_end=2024-04-03 02:34:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:34:06.223176653Z [2024-04-03T02:34:06.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:34:00+00:00, run_after=2024-04-03T02:35:00+00:00 2024-04-03T02:34:06.252740379Z [2024-04-03T02:34:06.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:33:00+00:00 exited with status success for try_number 1 2024-04-03T02:34:06.252762233Z [2024-04-03T02:34:06.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:33:00+00:00 exited with status success for try_number 1 2024-04-03T02:34:06.258914769Z [2024-04-03T02:34:06.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:33:00+00:00, map_index=-1, run_start_date=2024-04-03 02:34:03.454674+00:00, run_end_date=2024-04-03 02:34:05.664880+00:00, run_duration=2.210206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:34:00.945973+00:00, queued_by_job_id=1, pid=5298 2024-04-03T02:34:06.258978548Z [2024-04-03T02:34:06.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:33:00+00:00, map_index=-1, run_start_date=2024-04-03 02:34:03.184032+00:00, run_end_date=2024-04-03 02:34:05.918395+00:00, run_duration=2.734363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:34:00.945973+00:00, queued_by_job_id=1, pid=5292 2024-04-03T02:35:00.707855448Z [2024-04-03T02:35:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:35:00+00:00, run_after=2024-04-03T02:36:00+00:00 2024-04-03T02:35:00.726361976Z [2024-04-03T02:35:00.725+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:35:00+00:00, run_after=2024-04-03T02:40:00+00:00 2024-04-03T02:35:00.736685661Z [2024-04-03T02:35:00.736+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:35:00.898375642Z [2024-04-03T02:35:00.897+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:35:00.898396397Z 2024-04-03T02:35:00.898400558Z 2024-04-03T02:35:00.898403793Z 2024-04-03T02:35:00.898790291Z [2024-04-03T02:35:00.898+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:35:00.899006424Z [2024-04-03T02:35:00.898+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:35:00.899284383Z [2024-04-03T02:35:00.899+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:35:00.900076234Z [2024-04-03T02:35:00.899+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:35:00.900087331Z 2024-04-03T02:35:00.900091090Z 2024-04-03T02:35:00.900094170Z 2024-04-03T02:35:00.904790487Z [2024-04-03T02:35:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:35:00.905099800Z [2024-04-03T02:35:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:35:00.905425625Z [2024-04-03T02:35:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:35:00.905557588Z [2024-04-03T02:35:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:35:00.905794096Z [2024-04-03T02:35:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:35:00.905934177Z [2024-04-03T02:35:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:35:01.236173073Z [2024-04-03T02:35:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status queued for try_number 1 2024-04-03T02:35:01.236201049Z [2024-04-03T02:35:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:34:00+00:00 exited with status queued for try_number 1 2024-04-03T02:35:01.238244558Z [2024-04-03T02:35:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:34:00+00:00 exited with status queued for try_number 1 2024-04-03T02:35:01.250469216Z [2024-04-03T02:35:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to eda3499f-0748-44d6-840d-c4e719a8b5a9 2024-04-03T02:35:01.250625532Z [2024-04-03T02:35:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4a95411-b38e-4b81-b7f2-be7d1ae8cece 2024-04-03T02:35:01.251494755Z [2024-04-03T02:35:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30454038-d9c5-454f-b5c5-db8d5ab9d4da 2024-04-03T02:35:03.695822306Z [2024-04-03T02:35:03.695+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:35:03.695841292Z 2024-04-03T02:35:03.697597190Z [2024-04-03T02:35:03.695+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:35:03.701097533Z [2024-04-03T02:35:03.700+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:35:03.701123143Z 2024-04-03T02:35:03.704447861Z [2024-04-03T02:35:03.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:35:03.704766159Z [2024-04-03T02:35:03.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:35:03.853748393Z [2024-04-03T02:35:03.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status queued for try_number 1 2024-04-03T02:35:03.854028393Z [2024-04-03T02:35:03.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status success for try_number 1 2024-04-03T02:35:03.861040285Z [2024-04-03T02:35:03.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddfba728-a618-4e46-b691-30d405a5c34c 2024-04-03T02:35:03.861591060Z [2024-04-03T02:35:03.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:30:00+00:00, map_index=-1, run_start_date=2024-04-03 02:35:02.928270+00:00, run_end_date=2024-04-03 02:35:03.515987+00:00, run_duration=0.587717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:35:00.901280+00:00, queued_by_job_id=1, pid=5354 2024-04-03T02:35:05.485093228Z [2024-04-03T02:35:05.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:35:05.485499269Z [2024-04-03T02:35:05.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:34:00+00:00, run_id=scheduled__2024-04-03T02:34:00+00:00, run_start_date=2024-04-03 02:35:00.771312+00:00, run_end_date=2024-04-03 02:35:05.484963+00:00, run_duration=4.713651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:34:00+00:00, data_interval_end=2024-04-03 02:35:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:35:05.503134784Z [2024-04-03T02:35:05.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:35:00+00:00, run_after=2024-04-03T02:36:00+00:00 2024-04-03T02:35:05.554978507Z [2024-04-03T02:35:05.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:34:00+00:00 exited with status success for try_number 1 2024-04-03T02:35:05.560576978Z [2024-04-03T02:35:05.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:34:00+00:00, map_index=-1, run_start_date=2024-04-03 02:35:03.375709+00:00, run_end_date=2024-04-03 02:35:05.382007+00:00, run_duration=2.006298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:35:00.901280+00:00, queued_by_job_id=1, pid=5373 2024-04-03T02:35:06.639078031Z [2024-04-03T02:35:06.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:35:06.639117549Z [2024-04-03T02:35:06.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:34:00+00:00, run_id=scheduled__2024-04-03T02:34:00+00:00, run_start_date=2024-04-03 02:35:00.767089+00:00, run_end_date=2024-04-03 02:35:06.632279+00:00, run_duration=5.86519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:34:00+00:00, data_interval_end=2024-04-03 02:35:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:35:06.642831110Z [2024-04-03T02:35:06.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:35:00+00:00, run_after=2024-04-03T02:36:00+00:00 2024-04-03T02:35:06.673831599Z [2024-04-03T02:35:06.672+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:35:06.673858395Z 2024-04-03T02:35:06.673864405Z [2024-04-03T02:35:06.672+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:35:06.681419903Z [2024-04-03T02:35:06.680+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:35:06.681444844Z 2024-04-03T02:35:06.686355121Z [2024-04-03T02:35:06.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:35:06.686531123Z [2024-04-03T02:35:06.686+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:35:06.745772735Z [2024-04-03T02:35:06.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status queued for try_number 1 2024-04-03T02:35:06.746042017Z [2024-04-03T02:35:06.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:34:00+00:00 exited with status success for try_number 1 2024-04-03T02:35:06.746312293Z [2024-04-03T02:35:06.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status success for try_number 1 2024-04-03T02:35:06.755823676Z [2024-04-03T02:35:06.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:30:00+00:00, map_index=-1, run_start_date=2024-04-03 02:35:05.488494+00:00, run_end_date=2024-04-03 02:35:05.797032+00:00, run_duration=0.308538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:35:03.701570+00:00, queued_by_job_id=1, pid=5404 2024-04-03T02:35:06.756329346Z [2024-04-03T02:35:06.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:34:00+00:00, map_index=-1, run_start_date=2024-04-03 02:35:03.233742+00:00, run_end_date=2024-04-03 02:35:05.582745+00:00, run_duration=2.349003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:35:00.901280+00:00, queued_by_job_id=1, pid=5364 2024-04-03T02:35:06.756662236Z [2024-04-03T02:35:06.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2421d86-0a5a-41a6-b3f7-d3a431774672 2024-04-03T02:35:08.955241442Z [2024-04-03T02:35:08.954+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:35:08.955274730Z 2024-04-03T02:35:08.955451131Z [2024-04-03T02:35:08.955+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:35:08.956102661Z [2024-04-03T02:35:08.955+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:35:08.956118294Z 2024-04-03T02:35:08.959668703Z [2024-04-03T02:35:08.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:35:08.959848938Z [2024-04-03T02:35:08.959+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:35:09.014845672Z [2024-04-03T02:35:09.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status queued for try_number 1 2024-04-03T02:35:09.014985565Z [2024-04-03T02:35:09.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status success for try_number 1 2024-04-03T02:35:09.022555929Z [2024-04-03T02:35:09.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a4d0a5e-f2b8-4072-a104-6235b34e76ac 2024-04-03T02:35:09.027236379Z [2024-04-03T02:35:09.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:30:00+00:00, map_index=0, run_start_date=2024-04-03 02:35:08.301049+00:00, run_end_date=2024-04-03 02:35:08.677559+00:00, run_duration=0.37651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:35:06.684167+00:00, queued_by_job_id=1, pid=5416 2024-04-03T02:35:11.276334708Z [2024-04-03T02:35:11.275+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:35:11.276740066Z [2024-04-03T02:35:11.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:30:00+00:00, run_id=scheduled__2024-04-03T02:30:00+00:00, run_start_date=2024-04-03 02:35:00.761740+00:00, run_end_date=2024-04-03 02:35:11.276241+00:00, run_duration=10.514501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:30:00+00:00, data_interval_end=2024-04-03 02:35:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:35:11.282697343Z [2024-04-03T02:35:11.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:35:00+00:00, run_after=2024-04-03T02:40:00+00:00 2024-04-03T02:35:11.314408004Z [2024-04-03T02:35:11.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:30:00+00:00 exited with status success for try_number 1 2024-04-03T02:35:11.321234438Z [2024-04-03T02:35:11.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:30:00+00:00, map_index=-1, run_start_date=2024-04-03 02:35:10.660391+00:00, run_end_date=2024-04-03 02:35:10.989356+00:00, run_duration=0.328965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:35:08.957043+00:00, queued_by_job_id=1, pid=5428 2024-04-03T02:36:00.822671852Z [2024-04-03T02:36:00.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:36:00+00:00, run_after=2024-04-03T02:37:00+00:00 2024-04-03T02:36:00.833920915Z [2024-04-03T02:36:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:36:00.862104153Z [2024-04-03T02:36:00.861+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:36:00.947668429Z [2024-04-03T02:36:00.947+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:36:00.947691096Z 2024-04-03T02:36:00.947696380Z 2024-04-03T02:36:00.947701297Z 2024-04-03T02:36:00.947839869Z [2024-04-03T02:36:00.947+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:36:00.947976278Z [2024-04-03T02:36:00.947+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:36:00.948082266Z [2024-04-03T02:36:00.947+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:36:00.948672070Z [2024-04-03T02:36:00.948+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:36:00.948684932Z 2024-04-03T02:36:00.948690889Z 2024-04-03T02:36:00.948696746Z 2024-04-03T02:36:00.956278523Z [2024-04-03T02:36:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:36:00.960699926Z [2024-04-03T02:36:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:36:00.961026226Z [2024-04-03T02:36:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:36:00.961152510Z [2024-04-03T02:36:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:36:00.961389268Z [2024-04-03T02:36:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:36:00.961483987Z [2024-04-03T02:36:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:36:01.350707264Z [2024-04-03T02:36:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:34:00+00:00 exited with status queued for try_number 1 2024-04-03T02:36:01.350873971Z [2024-04-03T02:36:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status queued for try_number 1 2024-04-03T02:36:01.350966454Z [2024-04-03T02:36:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status queued for try_number 1 2024-04-03T02:36:01.392180076Z [2024-04-03T02:36:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to a41d2c94-9e45-4eda-b1a8-8728f5bba8e2 2024-04-03T02:36:01.410995916Z [2024-04-03T02:36:01.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b412e2c-cc4f-4b7d-9140-1ddaa288b460 2024-04-03T02:36:01.411278146Z [2024-04-03T02:36:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61571c3a-977b-40ad-b5eb-466853429228 2024-04-03T02:36:03.699230337Z [2024-04-03T02:36:03.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:36:03.699361852Z [2024-04-03T02:36:03.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:34:00+00:00, run_id=scheduled__2024-04-03T02:34:00+00:00, run_start_date=2024-04-03 02:36:00.876633+00:00, run_end_date=2024-04-03 02:36:03.699074+00:00, run_duration=2.822441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:34:00+00:00, data_interval_end=2024-04-03 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:36:03.708877817Z [2024-04-03T02:36:03.708+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:36:00+00:00, run_after=2024-04-03T02:38:00+00:00 2024-04-03T02:36:03.797220833Z [2024-04-03T02:36:03.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:34:00+00:00 exited with status success for try_number 1 2024-04-03T02:36:03.808419557Z [2024-04-03T02:36:03.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:34:00+00:00, map_index=-1, run_start_date=2024-04-03 02:36:02.332034+00:00, run_end_date=2024-04-03 02:36:02.674251+00:00, run_duration=0.342217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:36:00.953663+00:00, queued_by_job_id=1, pid=5445 2024-04-03T02:36:05.889692570Z [2024-04-03T02:36:05.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:36:05.889866471Z [2024-04-03T02:36:05.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:35:00+00:00, run_id=scheduled__2024-04-03T02:35:00+00:00, run_start_date=2024-04-03 02:36:00.877796+00:00, run_end_date=2024-04-03 02:36:05.889343+00:00, run_duration=5.011547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:35:00+00:00, data_interval_end=2024-04-03 02:36:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:36:05.902456672Z [2024-04-03T02:36:05.901+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:36:00+00:00, run_after=2024-04-03T02:37:00+00:00 2024-04-03T02:36:05.911617226Z [2024-04-03T02:36:05.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:36:05.911739672Z [2024-04-03T02:36:05.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:35:00+00:00, run_id=scheduled__2024-04-03T02:35:00+00:00, run_start_date=2024-04-03 02:36:00.878794+00:00, run_end_date=2024-04-03 02:36:05.911339+00:00, run_duration=5.032545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:35:00+00:00, data_interval_end=2024-04-03 02:36:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:36:05.920655042Z [2024-04-03T02:36:05.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:36:00+00:00, run_after=2024-04-03T02:37:00+00:00 2024-04-03T02:36:05.963494874Z [2024-04-03T02:36:05.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status success for try_number 1 2024-04-03T02:36:05.963965022Z [2024-04-03T02:36:05.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status success for try_number 1 2024-04-03T02:36:05.980321626Z [2024-04-03T02:36:05.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:35:00+00:00, map_index=-1, run_start_date=2024-04-03 02:36:03.511874+00:00, run_end_date=2024-04-03 02:36:05.600172+00:00, run_duration=2.088298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:36:00.953663+00:00, queued_by_job_id=1, pid=5475 2024-04-03T02:36:05.980625929Z [2024-04-03T02:36:05.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:35:00+00:00, map_index=-1, run_start_date=2024-04-03 02:36:03.532695+00:00, run_end_date=2024-04-03 02:36:05.323919+00:00, run_duration=1.791224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:36:00.953663+00:00, queued_by_job_id=1, pid=5476 2024-04-03T02:36:35.495750474Z [2024-04-03T02:36:35.494+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:37:00.480653962Z [2024-04-03T02:37:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:37:00+00:00, run_after=2024-04-03T02:38:00+00:00 2024-04-03T02:37:00.500910603Z [2024-04-03T02:37:00.500+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:37:00.575071718Z [2024-04-03T02:37:00.574+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:37:00.575111292Z 2024-04-03T02:37:00.575115335Z 2024-04-03T02:37:00.575163126Z [2024-04-03T02:37:00.574+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:37:00.575464888Z [2024-04-03T02:37:00.575+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:37:00.576136853Z [2024-04-03T02:37:00.575+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:37:00.576148861Z 2024-04-03T02:37:00.576152427Z 2024-04-03T02:37:00.578937833Z [2024-04-03T02:37:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:37:00.579142390Z [2024-04-03T02:37:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:37:00.579488549Z [2024-04-03T02:37:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:37:00.579670792Z [2024-04-03T02:37:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:37:00.917962073Z [2024-04-03T02:37:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:36:00+00:00 exited with status queued for try_number 1 2024-04-03T02:37:00.923034166Z [2024-04-03T02:37:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:36:00+00:00 exited with status queued for try_number 1 2024-04-03T02:37:00.930518854Z [2024-04-03T02:37:00.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59b90639-ccb5-452a-b3b4-8ef01614fc56 2024-04-03T02:37:00.930742225Z [2024-04-03T02:37:00.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc79e9f0-5133-4b37-9c90-ff6130c2d54a 2024-04-03T02:37:04.398669888Z [2024-04-03T02:37:04.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:37:04.398705084Z [2024-04-03T02:37:04.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:36:00+00:00, run_id=scheduled__2024-04-03T02:36:00+00:00, run_start_date=2024-04-03 02:37:00.520841+00:00, run_end_date=2024-04-03 02:37:04.398269+00:00, run_duration=3.877428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:36:00+00:00, data_interval_end=2024-04-03 02:37:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:37:04.411690993Z [2024-04-03T02:37:04.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:37:00+00:00, run_after=2024-04-03T02:38:00+00:00 2024-04-03T02:37:04.448521689Z [2024-04-03T02:37:04.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:36:00+00:00 exited with status success for try_number 1 2024-04-03T02:37:04.453950521Z [2024-04-03T02:37:04.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:36:00+00:00, map_index=-1, run_start_date=2024-04-03 02:37:02.875486+00:00, run_end_date=2024-04-03 02:37:04.111812+00:00, run_duration=1.236326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:37:00.576778+00:00, queued_by_job_id=1, pid=5531 2024-04-03T02:37:05.501040927Z [2024-04-03T02:37:05.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:37:05.501353772Z [2024-04-03T02:37:05.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:36:00+00:00, run_id=scheduled__2024-04-03T02:36:00+00:00, run_start_date=2024-04-03 02:37:00.522936+00:00, run_end_date=2024-04-03 02:37:05.500880+00:00, run_duration=4.977944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:36:00+00:00, data_interval_end=2024-04-03 02:37:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:37:05.512280805Z [2024-04-03T02:37:05.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:37:00+00:00, run_after=2024-04-03T02:38:00+00:00 2024-04-03T02:37:05.551952620Z [2024-04-03T02:37:05.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:36:00+00:00 exited with status success for try_number 1 2024-04-03T02:37:05.558725394Z [2024-04-03T02:37:05.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:36:00+00:00, map_index=-1, run_start_date=2024-04-03 02:37:02.659002+00:00, run_end_date=2024-04-03 02:37:04.373287+00:00, run_duration=1.714285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:37:00.576778+00:00, queued_by_job_id=1, pid=5521 2024-04-03T02:38:00.900245638Z [2024-04-03T02:38:00.899+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:38:00.916211451Z [2024-04-03T02:38:00.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:38:00+00:00, run_after=2024-04-03T02:39:00+00:00 2024-04-03T02:38:00.923560768Z [2024-04-03T02:38:00.923+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:38:00.998792878Z [2024-04-03T02:38:00.998+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:38:00.998817686Z 2024-04-03T02:38:00.998822301Z 2024-04-03T02:38:00.998829847Z 2024-04-03T02:38:00.999041952Z [2024-04-03T02:38:00.998+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:38:00.999203734Z [2024-04-03T02:38:00.999+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:38:00.999490969Z [2024-04-03T02:38:00.999+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:38:01.000208677Z [2024-04-03T02:38:00.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:38:01.000220503Z 2024-04-03T02:38:01.000224081Z 2024-04-03T02:38:01.000227333Z 2024-04-03T02:38:01.007454169Z [2024-04-03T02:38:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:38:01.007692178Z [2024-04-03T02:38:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:38:01.007995222Z [2024-04-03T02:38:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:38:01.008215422Z [2024-04-03T02:38:01.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:38:01.008978919Z [2024-04-03T02:38:01.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:38:01.009130717Z [2024-04-03T02:38:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:38:01.416531288Z [2024-04-03T02:38:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:36:00+00:00 exited with status queued for try_number 1 2024-04-03T02:38:01.416567324Z [2024-04-03T02:38:01.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:37:00+00:00 exited with status queued for try_number 1 2024-04-03T02:38:01.416602681Z [2024-04-03T02:38:01.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:37:00+00:00 exited with status queued for try_number 1 2024-04-03T02:38:01.428111922Z [2024-04-03T02:38:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to d96765c9-9c7b-4f2b-a585-5d2b13fdc6e6 2024-04-03T02:38:01.428197149Z [2024-04-03T02:38:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 411d3d91-5833-485a-9940-cc2f7afef6ca 2024-04-03T02:38:01.428303626Z [2024-04-03T02:38:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97c423e6-6433-468a-985e-0e4f9ca18df7 2024-04-03T02:38:02.973311815Z [2024-04-03T02:38:02.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:38:02.973778760Z [2024-04-03T02:38:02.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:36:00+00:00, run_id=scheduled__2024-04-03T02:36:00+00:00, run_start_date=2024-04-03 02:38:00.936986+00:00, run_end_date=2024-04-03 02:38:02.973361+00:00, run_duration=2.036375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:36:00+00:00, data_interval_end=2024-04-03 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:38:02.990623217Z [2024-04-03T02:38:02.990+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:38:00+00:00, run_after=2024-04-03T02:40:00+00:00 2024-04-03T02:38:03.103506829Z [2024-04-03T02:38:03.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:36:00+00:00 exited with status success for try_number 1 2024-04-03T02:38:03.114832548Z [2024-04-03T02:38:03.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:36:00+00:00, map_index=-1, run_start_date=2024-04-03 02:38:02.015554+00:00, run_end_date=2024-04-03 02:38:02.442746+00:00, run_duration=0.427192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:38:01.003283+00:00, queued_by_job_id=1, pid=5566 2024-04-03T02:38:05.283673659Z [2024-04-03T02:38:05.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:38:05.284299020Z [2024-04-03T02:38:05.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:37:00+00:00, run_id=scheduled__2024-04-03T02:37:00+00:00, run_start_date=2024-04-03 02:38:00.938244+00:00, run_end_date=2024-04-03 02:38:05.283816+00:00, run_duration=4.345572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:37:00+00:00, data_interval_end=2024-04-03 02:38:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:38:05.295708257Z [2024-04-03T02:38:05.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:38:00+00:00, run_after=2024-04-03T02:39:00+00:00 2024-04-03T02:38:05.338258162Z [2024-04-03T02:38:05.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:37:00+00:00 exited with status success for try_number 1 2024-04-03T02:38:05.344579058Z [2024-04-03T02:38:05.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:37:00+00:00, map_index=-1, run_start_date=2024-04-03 02:38:03.188478+00:00, run_end_date=2024-04-03 02:38:04.938867+00:00, run_duration=1.750389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:38:01.003283+00:00, queued_by_job_id=1, pid=5597 2024-04-03T02:38:06.378990147Z [2024-04-03T02:38:06.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:38:06.379310889Z [2024-04-03T02:38:06.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:37:00+00:00, run_id=scheduled__2024-04-03T02:37:00+00:00, run_start_date=2024-04-03 02:38:00.939896+00:00, run_end_date=2024-04-03 02:38:06.378860+00:00, run_duration=5.438964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:37:00+00:00, data_interval_end=2024-04-03 02:38:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:38:06.397749777Z [2024-04-03T02:38:06.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:38:00+00:00, run_after=2024-04-03T02:39:00+00:00 2024-04-03T02:38:06.435197310Z [2024-04-03T02:38:06.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:37:00+00:00 exited with status success for try_number 1 2024-04-03T02:38:06.440253232Z [2024-04-03T02:38:06.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:37:00+00:00, map_index=-1, run_start_date=2024-04-03 02:38:03.141926+00:00, run_end_date=2024-04-03 02:38:05.297876+00:00, run_duration=2.15595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:38:01.003283+00:00, queued_by_job_id=1, pid=5596 2024-04-03T02:39:00.870250973Z [2024-04-03T02:39:00.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:39:00+00:00, run_after=2024-04-03T02:40:00+00:00 2024-04-03T02:39:00.879524366Z [2024-04-03T02:39:00.879+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:39:00.932042574Z [2024-04-03T02:39:00.931+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:39:00.932105229Z 2024-04-03T02:39:00.932109353Z 2024-04-03T02:39:00.932312114Z [2024-04-03T02:39:00.932+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:39:00.932497915Z [2024-04-03T02:39:00.932+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:39:00.933272813Z [2024-04-03T02:39:00.933+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:39:00.933283832Z 2024-04-03T02:39:00.933287345Z 2024-04-03T02:39:00.937197342Z [2024-04-03T02:39:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:39:00.937448686Z [2024-04-03T02:39:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:39:00.937754020Z [2024-04-03T02:39:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:39:00.937940984Z [2024-04-03T02:39:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:39:01.161831991Z [2024-04-03T02:39:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:38:00+00:00 exited with status queued for try_number 1 2024-04-03T02:39:01.162197728Z [2024-04-03T02:39:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:38:00+00:00 exited with status queued for try_number 1 2024-04-03T02:39:01.176286412Z [2024-04-03T02:39:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc0a0e49-3b45-4126-b86b-25c11f8f4365 2024-04-03T02:39:01.178305906Z [2024-04-03T02:39:01.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5f0d4ea-a9aa-4cd2-9101-16b024edb494 2024-04-03T02:39:04.980335028Z [2024-04-03T02:39:04.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:39:04.981092464Z [2024-04-03T02:39:04.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:38:00+00:00, run_id=scheduled__2024-04-03T02:38:00+00:00, run_start_date=2024-04-03 02:39:00.890206+00:00, run_end_date=2024-04-03 02:39:04.980214+00:00, run_duration=4.090008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:38:00+00:00, data_interval_end=2024-04-03 02:39:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:39:04.991568044Z [2024-04-03T02:39:04.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:39:00+00:00, run_after=2024-04-03T02:40:00+00:00 2024-04-03T02:39:06.085736335Z [2024-04-03T02:39:06.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:39:06.085914962Z [2024-04-03T02:39:06.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:38:00+00:00, run_id=scheduled__2024-04-03T02:38:00+00:00, run_start_date=2024-04-03 02:39:00.891528+00:00, run_end_date=2024-04-03 02:39:06.085637+00:00, run_duration=5.194109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:38:00+00:00, data_interval_end=2024-04-03 02:39:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:39:06.096065481Z [2024-04-03T02:39:06.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:39:00+00:00, run_after=2024-04-03T02:40:00+00:00 2024-04-03T02:39:06.136980314Z [2024-04-03T02:39:06.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:38:00+00:00 exited with status success for try_number 1 2024-04-03T02:39:06.137021314Z [2024-04-03T02:39:06.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:38:00+00:00 exited with status success for try_number 1 2024-04-03T02:39:06.145353585Z [2024-04-03T02:39:06.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:38:00+00:00, map_index=-1, run_start_date=2024-04-03 02:39:03.183258+00:00, run_end_date=2024-04-03 02:39:04.955839+00:00, run_duration=1.772581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:39:00.934187+00:00, queued_by_job_id=1, pid=5651 2024-04-03T02:39:06.145433465Z [2024-04-03T02:39:06.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:38:00+00:00, map_index=-1, run_start_date=2024-04-03 02:39:03.349483+00:00, run_end_date=2024-04-03 02:39:05.322937+00:00, run_duration=1.973454, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:39:00.934187+00:00, queued_by_job_id=1, pid=5652 2024-04-03T02:40:00.736346185Z [2024-04-03T02:40:00.735+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:40:00.758682416Z [2024-04-03T02:40:00.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:40:00+00:00, run_after=2024-04-03T02:45:00+00:00 2024-04-03T02:40:00.778717898Z [2024-04-03T02:40:00.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:40:00+00:00, run_after=2024-04-03T02:41:00+00:00 2024-04-03T02:40:00.798699628Z [2024-04-03T02:40:00.795+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:40:00.916838409Z [2024-04-03T02:40:00.916+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T02:40:00.916885547Z 2024-04-03T02:40:00.916896566Z 2024-04-03T02:40:00.916911741Z 2024-04-03T02:40:00.916922005Z 2024-04-03T02:40:00.916945926Z [2024-04-03T02:40:00.916+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:40:00.917152091Z [2024-04-03T02:40:00.916+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:40:00.917293287Z [2024-04-03T02:40:00.917+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:40:00.918644623Z [2024-04-03T02:40:00.918+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:40:00.919249892Z [2024-04-03T02:40:00.918+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:40:00.919273302Z 2024-04-03T02:40:00.919285010Z 2024-04-03T02:40:00.919296065Z 2024-04-03T02:40:00.919306190Z 2024-04-03T02:40:00.923314150Z [2024-04-03T02:40:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:40:00.923415130Z [2024-04-03T02:40:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:40:00.923802377Z [2024-04-03T02:40:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:40:00.923929426Z [2024-04-03T02:40:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:40:00.924187681Z [2024-04-03T02:40:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:40:00.924335790Z [2024-04-03T02:40:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:40:00.924634457Z [2024-04-03T02:40:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:40:00.924760859Z [2024-04-03T02:40:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:40:01.369695492Z [2024-04-03T02:40:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status queued for try_number 1 2024-04-03T02:40:01.369727353Z [2024-04-03T02:40:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:38:00+00:00 exited with status queued for try_number 1 2024-04-03T02:40:01.369743904Z [2024-04-03T02:40:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:39:00+00:00 exited with status queued for try_number 1 2024-04-03T02:40:01.369752354Z [2024-04-03T02:40:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:39:00+00:00 exited with status queued for try_number 1 2024-04-03T02:40:01.391129049Z [2024-04-03T02:40:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e5513d7-46e7-4162-8133-0da5bec554c0 2024-04-03T02:40:01.391192640Z [2024-04-03T02:40:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff4f93b5-2d2f-46c5-81f8-2a0b5a0565f8 2024-04-03T02:40:01.391251683Z [2024-04-03T02:40:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9048892b-6ce8-450d-ba93-6f1c9cd5a4ef 2024-04-03T02:40:01.391321610Z [2024-04-03T02:40:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74491bdf-4971-4944-b7c2-07e2c903d7b5 2024-04-03T02:40:02.726542787Z [2024-04-03T02:40:02.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:40:02.726921020Z [2024-04-03T02:40:02.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:38:00+00:00, run_id=scheduled__2024-04-03T02:38:00+00:00, run_start_date=2024-04-03 02:40:00.817995+00:00, run_end_date=2024-04-03 02:40:02.726459+00:00, run_duration=1.908464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:38:00+00:00, data_interval_end=2024-04-03 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:40:02.736244878Z [2024-04-03T02:40:02.735+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:40:00+00:00, run_after=2024-04-03T02:42:00+00:00 2024-04-03T02:40:02.818024157Z [2024-04-03T02:40:02.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:38:00+00:00 exited with status success for try_number 1 2024-04-03T02:40:02.830736282Z [2024-04-03T02:40:02.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:38:00+00:00, map_index=-1, run_start_date=2024-04-03 02:40:02.180030+00:00, run_end_date=2024-04-03 02:40:02.540490+00:00, run_duration=0.36046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:40:00.920375+00:00, queued_by_job_id=1, pid=5689 2024-04-03T02:40:04.922092809Z [2024-04-03T02:40:04.921+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:40:04.922124120Z 2024-04-03T02:40:04.922495986Z [2024-04-03T02:40:04.921+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:40:04.923088639Z [2024-04-03T02:40:04.922+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:40:04.923099941Z 2024-04-03T02:40:04.925489158Z [2024-04-03T02:40:04.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:40:04.925703133Z [2024-04-03T02:40:04.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:40:04.992191927Z [2024-04-03T02:40:04.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status queued for try_number 1 2024-04-03T02:40:04.992361250Z [2024-04-03T02:40:04.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status success for try_number 1 2024-04-03T02:40:04.999904639Z [2024-04-03T02:40:04.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to e779488e-0407-4439-8760-b711b472b52b 2024-04-03T02:40:05.000596895Z [2024-04-03T02:40:05.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:35:00+00:00, map_index=-1, run_start_date=2024-04-03 02:40:04.254577+00:00, run_end_date=2024-04-03 02:40:04.812937+00:00, run_duration=0.55836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:40:00.920375+00:00, queued_by_job_id=1, pid=5731 2024-04-03T02:40:06.209634653Z [2024-04-03T02:40:06.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:40:06.210099235Z [2024-04-03T02:40:06.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:39:00+00:00, run_id=scheduled__2024-04-03T02:39:00+00:00, run_start_date=2024-04-03 02:40:00.819249+00:00, run_end_date=2024-04-03 02:40:06.209723+00:00, run_duration=5.390474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:39:00+00:00, data_interval_end=2024-04-03 02:40:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:40:06.235710112Z [2024-04-03T02:40:06.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:40:00+00:00, run_after=2024-04-03T02:41:00+00:00 2024-04-03T02:40:06.255988111Z [2024-04-03T02:40:06.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:40:06.259098567Z [2024-04-03T02:40:06.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:39:00+00:00, run_id=scheduled__2024-04-03T02:39:00+00:00, run_start_date=2024-04-03 02:40:00.822475+00:00, run_end_date=2024-04-03 02:40:06.255837+00:00, run_duration=5.433362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:39:00+00:00, data_interval_end=2024-04-03 02:40:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:40:06.284142227Z [2024-04-03T02:40:06.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:40:00+00:00, run_after=2024-04-03T02:41:00+00:00 2024-04-03T02:40:06.353727711Z [2024-04-03T02:40:06.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:39:00+00:00 exited with status success for try_number 1 2024-04-03T02:40:06.353787514Z [2024-04-03T02:40:06.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:39:00+00:00 exited with status success for try_number 1 2024-04-03T02:40:06.366971700Z [2024-04-03T02:40:06.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:39:00+00:00, map_index=-1, run_start_date=2024-04-03 02:40:03.961112+00:00, run_end_date=2024-04-03 02:40:05.663900+00:00, run_duration=1.702788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:40:00.920375+00:00, queued_by_job_id=1, pid=5729 2024-04-03T02:40:06.367899173Z [2024-04-03T02:40:06.367+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:39:00+00:00, map_index=-1, run_start_date=2024-04-03 02:40:03.993934+00:00, run_end_date=2024-04-03 02:40:06.025203+00:00, run_duration=2.031269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:40:00.920375+00:00, queued_by_job_id=1, pid=5730 2024-04-03T02:40:08.537931820Z [2024-04-03T02:40:08.537+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:40:08.537978314Z 2024-04-03T02:40:08.538441546Z [2024-04-03T02:40:08.538+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:40:08.539485669Z [2024-04-03T02:40:08.539+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:40:08.539502832Z 2024-04-03T02:40:08.542448587Z [2024-04-03T02:40:08.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:40:08.542857795Z [2024-04-03T02:40:08.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:40:08.603876649Z [2024-04-03T02:40:08.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status queued for try_number 1 2024-04-03T02:40:08.604663623Z [2024-04-03T02:40:08.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status success for try_number 1 2024-04-03T02:40:08.630353725Z [2024-04-03T02:40:08.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74a3f691-12f5-4d13-b30b-da770d77a088 2024-04-03T02:40:08.630376520Z [2024-04-03T02:40:08.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:35:00+00:00, map_index=-1, run_start_date=2024-04-03 02:40:06.919622+00:00, run_end_date=2024-04-03 02:40:07.301450+00:00, run_duration=0.381828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:40:04.923454+00:00, queued_by_job_id=1, pid=5770 2024-04-03T02:40:11.372456677Z [2024-04-03T02:40:11.372+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:40:11.372490106Z 2024-04-03T02:40:11.372563353Z [2024-04-03T02:40:11.372+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:40:11.373147298Z [2024-04-03T02:40:11.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:40:11.373153769Z 2024-04-03T02:40:11.375845783Z [2024-04-03T02:40:11.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:40:11.375989766Z [2024-04-03T02:40:11.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:40:11.431371018Z [2024-04-03T02:40:11.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status queued for try_number 1 2024-04-03T02:40:11.431483507Z [2024-04-03T02:40:11.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status success for try_number 1 2024-04-03T02:40:11.438331388Z [2024-04-03T02:40:11.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e50cdab-c358-4740-b555-4b0317816564 2024-04-03T02:40:11.438442462Z [2024-04-03T02:40:11.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:35:00+00:00, map_index=0, run_start_date=2024-04-03 02:40:10.429567+00:00, run_end_date=2024-04-03 02:40:10.819088+00:00, run_duration=0.389521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:40:08.539942+00:00, queued_by_job_id=1, pid=5782 2024-04-03T02:40:13.798228215Z [2024-04-03T02:40:13.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:40:13.798541978Z [2024-04-03T02:40:13.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:35:00+00:00, run_id=scheduled__2024-04-03T02:35:00+00:00, run_start_date=2024-04-03 02:40:00.816554+00:00, run_end_date=2024-04-03 02:40:13.798223+00:00, run_duration=12.981669, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:35:00+00:00, data_interval_end=2024-04-03 02:40:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:40:13.810243178Z [2024-04-03T02:40:13.809+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:40:00+00:00, run_after=2024-04-03T02:45:00+00:00 2024-04-03T02:40:13.842761737Z [2024-04-03T02:40:13.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:35:00+00:00 exited with status success for try_number 1 2024-04-03T02:40:13.855052146Z [2024-04-03T02:40:13.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:35:00+00:00, map_index=-1, run_start_date=2024-04-03 02:40:13.222976+00:00, run_end_date=2024-04-03 02:40:13.624743+00:00, run_duration=0.401767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:40:11.373480+00:00, queued_by_job_id=1, pid=5794 2024-04-03T02:41:00.791391233Z [2024-04-03T02:41:00.786+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:41:00.809365207Z [2024-04-03T02:41:00.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:41:00+00:00, run_after=2024-04-03T02:42:00+00:00 2024-04-03T02:41:00.904494345Z [2024-04-03T02:41:00.904+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:41:00.904514145Z 2024-04-03T02:41:00.904517896Z 2024-04-03T02:41:00.904796270Z [2024-04-03T02:41:00.904+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:41:00.904807287Z [2024-04-03T02:41:00.904+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:41:00.905586242Z [2024-04-03T02:41:00.905+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:41:00.905596389Z 2024-04-03T02:41:00.905599613Z 2024-04-03T02:41:00.908808108Z [2024-04-03T02:41:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:41:00.909008365Z [2024-04-03T02:41:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:41:00.909319063Z [2024-04-03T02:41:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:41:00.909494261Z [2024-04-03T02:41:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:41:01.202196965Z [2024-04-03T02:41:01.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status queued for try_number 1 2024-04-03T02:41:01.202377523Z [2024-04-03T02:41:01.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status queued for try_number 1 2024-04-03T02:41:01.215347020Z [2024-04-03T02:41:01.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 116a69cb-55ad-4f57-a5f3-7a44e5b71d6b 2024-04-03T02:41:01.215565353Z [2024-04-03T02:41:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to e87dfd63-4e94-4cea-bf0c-14224c34eace 2024-04-03T02:41:05.910430451Z [2024-04-03T02:41:05.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:41:05.911097491Z [2024-04-03T02:41:05.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:40:00+00:00, run_id=scheduled__2024-04-03T02:40:00+00:00, run_start_date=2024-04-03 02:41:00.845138+00:00, run_end_date=2024-04-03 02:41:05.910087+00:00, run_duration=5.064949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:40:00+00:00, data_interval_end=2024-04-03 02:41:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:41:05.927399319Z [2024-04-03T02:41:05.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:41:00+00:00, run_after=2024-04-03T02:42:00+00:00 2024-04-03T02:41:05.985501664Z [2024-04-03T02:41:05.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status success for try_number 1 2024-04-03T02:41:05.992650812Z [2024-04-03T02:41:05.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:40:00+00:00, map_index=-1, run_start_date=2024-04-03 02:41:03.040632+00:00, run_end_date=2024-04-03 02:41:05.073664+00:00, run_duration=2.033032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:41:00.906212+00:00, queued_by_job_id=1, pid=5830 2024-04-03T02:41:07.060258024Z [2024-04-03T02:41:07.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:41:07.061279220Z [2024-04-03T02:41:07.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:40:00+00:00, run_id=scheduled__2024-04-03T02:40:00+00:00, run_start_date=2024-04-03 02:41:00.846663+00:00, run_end_date=2024-04-03 02:41:07.060586+00:00, run_duration=6.213923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:40:00+00:00, data_interval_end=2024-04-03 02:41:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:41:07.081139328Z [2024-04-03T02:41:07.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:41:00+00:00, run_after=2024-04-03T02:42:00+00:00 2024-04-03T02:41:07.135908564Z [2024-04-03T02:41:07.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status success for try_number 1 2024-04-03T02:41:07.147684943Z [2024-04-03T02:41:07.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:40:00+00:00, map_index=-1, run_start_date=2024-04-03 02:41:03.096156+00:00, run_end_date=2024-04-03 02:41:05.912615+00:00, run_duration=2.816459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:41:00.906212+00:00, queued_by_job_id=1, pid=5831 2024-04-03T02:41:35.569079724Z [2024-04-03T02:41:35.568+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:42:00.248638838Z [2024-04-03T02:42:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:42:00+00:00, run_after=2024-04-03T02:43:00+00:00 2024-04-03T02:42:00.260383176Z [2024-04-03T02:42:00.260+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:42:00.267051422Z [2024-04-03T02:42:00.266+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:42:00.325828638Z [2024-04-03T02:42:00.325+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:42:00.325854041Z 2024-04-03T02:42:00.325860947Z 2024-04-03T02:42:00.325864309Z 2024-04-03T02:42:00.326103742Z [2024-04-03T02:42:00.325+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:42:00.326313594Z [2024-04-03T02:42:00.326+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:42:00.326495524Z [2024-04-03T02:42:00.326+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:42:00.327132842Z [2024-04-03T02:42:00.326+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:42:00.327164433Z 2024-04-03T02:42:00.327168494Z 2024-04-03T02:42:00.327171805Z 2024-04-03T02:42:00.330924997Z [2024-04-03T02:42:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:42:00.331162997Z [2024-04-03T02:42:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:42:00.331492951Z [2024-04-03T02:42:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:42:00.331730593Z [2024-04-03T02:42:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:42:00.332152464Z [2024-04-03T02:42:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:42:00.332391545Z [2024-04-03T02:42:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:42:00.734243372Z [2024-04-03T02:42:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status queued for try_number 1 2024-04-03T02:42:00.737744713Z [2024-04-03T02:42:00.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:41:00+00:00 exited with status queued for try_number 1 2024-04-03T02:42:00.737965420Z [2024-04-03T02:42:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:41:00+00:00 exited with status queued for try_number 1 2024-04-03T02:42:00.758744783Z [2024-04-03T02:42:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9264280-b8f5-41ad-be1c-b2cd845d07f8 2024-04-03T02:42:00.758763221Z [2024-04-03T02:42:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0f15e40-42cd-4f9b-b725-0547f765d9c0 2024-04-03T02:42:00.758774377Z [2024-04-03T02:42:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to d19eccb7-1f43-4c81-98c6-670463a6e905 2024-04-03T02:42:01.971084297Z [2024-04-03T02:42:01.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:42:01.971659699Z [2024-04-03T02:42:01.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:40:00+00:00, run_id=scheduled__2024-04-03T02:40:00+00:00, run_start_date=2024-04-03 02:42:00.276082+00:00, run_end_date=2024-04-03 02:42:01.970964+00:00, run_duration=1.694882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:40:00+00:00, data_interval_end=2024-04-03 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:42:01.981899575Z [2024-04-03T02:42:01.981+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:42:00+00:00, run_after=2024-04-03T02:44:00+00:00 2024-04-03T02:42:02.031465914Z [2024-04-03T02:42:02.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status success for try_number 1 2024-04-03T02:42:02.036808666Z [2024-04-03T02:42:02.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:40:00+00:00, map_index=-1, run_start_date=2024-04-03 02:42:01.431905+00:00, run_end_date=2024-04-03 02:42:01.803325+00:00, run_duration=0.37142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:42:00.327823+00:00, queued_by_job_id=1, pid=5866 2024-04-03T02:42:04.163132116Z [2024-04-03T02:42:04.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:42:04.163500944Z [2024-04-03T02:42:04.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:41:00+00:00, run_id=scheduled__2024-04-03T02:41:00+00:00, run_start_date=2024-04-03 02:42:00.277225+00:00, run_end_date=2024-04-03 02:42:04.163211+00:00, run_duration=3.885986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:41:00+00:00, data_interval_end=2024-04-03 02:42:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:42:04.173611767Z [2024-04-03T02:42:04.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:42:00+00:00, run_after=2024-04-03T02:43:00+00:00 2024-04-03T02:42:04.209851228Z [2024-04-03T02:42:04.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:41:00+00:00 exited with status success for try_number 1 2024-04-03T02:42:04.216697286Z [2024-04-03T02:42:04.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:41:00+00:00, map_index=-1, run_start_date=2024-04-03 02:42:02.705039+00:00, run_end_date=2024-04-03 02:42:04.038299+00:00, run_duration=1.33326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:42:00.327823+00:00, queued_by_job_id=1, pid=5896 2024-04-03T02:42:05.829196160Z [2024-04-03T02:42:05.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:42:05.829431575Z [2024-04-03T02:42:05.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:41:00+00:00, run_id=scheduled__2024-04-03T02:41:00+00:00, run_start_date=2024-04-03 02:42:00.278750+00:00, run_end_date=2024-04-03 02:42:05.829101+00:00, run_duration=5.550351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:41:00+00:00, data_interval_end=2024-04-03 02:42:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:42:05.841229091Z [2024-04-03T02:42:05.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:42:00+00:00, run_after=2024-04-03T02:43:00+00:00 2024-04-03T02:42:05.873953610Z [2024-04-03T02:42:05.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:41:00+00:00 exited with status success for try_number 1 2024-04-03T02:42:05.878652465Z [2024-04-03T02:42:05.878+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:41:00+00:00, map_index=-1, run_start_date=2024-04-03 02:42:02.799057+00:00, run_end_date=2024-04-03 02:42:05.491776+00:00, run_duration=2.692719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:42:00.327823+00:00, queued_by_job_id=1, pid=5897 2024-04-03T02:43:00.656588882Z [2024-04-03T02:43:00.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:43:00+00:00, run_after=2024-04-03T02:44:00+00:00 2024-04-03T02:43:00.675404937Z [2024-04-03T02:43:00.675+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:43:00.823945279Z [2024-04-03T02:43:00.821+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:43:00.823970008Z 2024-04-03T02:43:00.823973788Z 2024-04-03T02:43:00.823976905Z [2024-04-03T02:43:00.821+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:43:00.823979918Z [2024-04-03T02:43:00.821+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:43:00.823983681Z [2024-04-03T02:43:00.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:43:00.823986554Z 2024-04-03T02:43:00.823989518Z 2024-04-03T02:43:00.825922695Z [2024-04-03T02:43:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:43:00.825954048Z [2024-04-03T02:43:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:43:00.825957875Z [2024-04-03T02:43:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:43:00.829885308Z [2024-04-03T02:43:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:43:01.070011029Z [2024-04-03T02:43:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:42:00+00:00 exited with status queued for try_number 1 2024-04-03T02:43:01.070165489Z [2024-04-03T02:43:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:42:00+00:00 exited with status queued for try_number 1 2024-04-03T02:43:01.084282824Z [2024-04-03T02:43:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07097249-e566-4e61-bd3f-8a6a292f0561 2024-04-03T02:43:01.084614152Z [2024-04-03T02:43:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2acda556-8cfd-47a2-a721-27a5b4fcc0ef 2024-04-03T02:43:06.034981730Z [2024-04-03T02:43:06.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:43:06.035396068Z [2024-04-03T02:43:06.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:42:00+00:00, run_id=scheduled__2024-04-03T02:42:00+00:00, run_start_date=2024-04-03 02:43:00.699468+00:00, run_end_date=2024-04-03 02:43:06.034894+00:00, run_duration=5.335426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:42:00+00:00, data_interval_end=2024-04-03 02:43:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:43:06.048716142Z [2024-04-03T02:43:06.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:43:00+00:00, run_after=2024-04-03T02:44:00+00:00 2024-04-03T02:43:06.055142445Z [2024-04-03T02:43:06.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:43:06.055403458Z [2024-04-03T02:43:06.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:42:00+00:00, run_id=scheduled__2024-04-03T02:42:00+00:00, run_start_date=2024-04-03 02:43:00.704819+00:00, run_end_date=2024-04-03 02:43:06.055065+00:00, run_duration=5.350246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:42:00+00:00, data_interval_end=2024-04-03 02:43:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:43:06.064723676Z [2024-04-03T02:43:06.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:43:00+00:00, run_after=2024-04-03T02:44:00+00:00 2024-04-03T02:43:06.108360537Z [2024-04-03T02:43:06.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:42:00+00:00 exited with status success for try_number 1 2024-04-03T02:43:06.108398648Z [2024-04-03T02:43:06.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:42:00+00:00 exited with status success for try_number 1 2024-04-03T02:43:06.118156827Z [2024-04-03T02:43:06.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:42:00+00:00, map_index=-1, run_start_date=2024-04-03 02:43:02.932798+00:00, run_end_date=2024-04-03 02:43:05.200329+00:00, run_duration=2.267531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:43:00.822775+00:00, queued_by_job_id=1, pid=5952 2024-04-03T02:43:06.118498218Z [2024-04-03T02:43:06.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:42:00+00:00, map_index=-1, run_start_date=2024-04-03 02:43:03.046401+00:00, run_end_date=2024-04-03 02:43:05.693743+00:00, run_duration=2.647342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:43:00.822775+00:00, queued_by_job_id=1, pid=5953 2024-04-03T02:44:00.967418606Z [2024-04-03T02:44:00.966+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:44:00.973719036Z [2024-04-03T02:44:00.973+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:44:00.985366187Z [2024-04-03T02:44:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:44:00+00:00, run_after=2024-04-03T02:45:00+00:00 2024-04-03T02:44:01.090123858Z [2024-04-03T02:44:01.089+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:44:01.090146920Z 2024-04-03T02:44:01.090151102Z 2024-04-03T02:44:01.090154234Z 2024-04-03T02:44:01.090328085Z [2024-04-03T02:44:01.090+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:44:01.090514064Z [2024-04-03T02:44:01.090+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:44:01.090731552Z [2024-04-03T02:44:01.090+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:44:01.091368002Z [2024-04-03T02:44:01.091+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:44:01.091374051Z 2024-04-03T02:44:01.091377523Z 2024-04-03T02:44:01.091380487Z 2024-04-03T02:44:01.095262660Z [2024-04-03T02:44:01.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:44:01.095487962Z [2024-04-03T02:44:01.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:44:01.095871350Z [2024-04-03T02:44:01.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:44:01.096052064Z [2024-04-03T02:44:01.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:44:01.096315736Z [2024-04-03T02:44:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:44:01.096489016Z [2024-04-03T02:44:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:44:01.463012297Z [2024-04-03T02:44:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:42:00+00:00 exited with status queued for try_number 1 2024-04-03T02:44:01.463129007Z [2024-04-03T02:44:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:43:00+00:00 exited with status queued for try_number 1 2024-04-03T02:44:01.463214708Z [2024-04-03T02:44:01.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:43:00+00:00 exited with status queued for try_number 1 2024-04-03T02:44:01.474802033Z [2024-04-03T02:44:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fdf63c3-0724-41d3-8a76-3421de48ff57 2024-04-03T02:44:01.476562184Z [2024-04-03T02:44:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2daa20cc-ec1d-4361-93f0-d82bed71faa5 2024-04-03T02:44:01.476632589Z [2024-04-03T02:44:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21a911fa-4c5c-4c5a-a4cd-7229b9191f73 2024-04-03T02:44:02.463109594Z [2024-04-03T02:44:02.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:44:02.463380193Z [2024-04-03T02:44:02.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:42:00+00:00, run_id=scheduled__2024-04-03T02:42:00+00:00, run_start_date=2024-04-03 02:44:01.019185+00:00, run_end_date=2024-04-03 02:44:02.463034+00:00, run_duration=1.443849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:42:00+00:00, data_interval_end=2024-04-03 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:44:02.472492207Z [2024-04-03T02:44:02.472+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:44:00+00:00, run_after=2024-04-03T02:46:00+00:00 2024-04-03T02:44:03.695296900Z [2024-04-03T02:44:03.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:42:00+00:00 exited with status success for try_number 1 2024-04-03T02:44:03.709329904Z [2024-04-03T02:44:03.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:42:00+00:00, map_index=-1, run_start_date=2024-04-03 02:44:02.057493+00:00, run_end_date=2024-04-03 02:44:02.432243+00:00, run_duration=0.37475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:44:01.092198+00:00, queued_by_job_id=1, pid=5988 2024-04-03T02:44:06.920130547Z [2024-04-03T02:44:06.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:44:06.920676448Z [2024-04-03T02:44:06.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:43:00+00:00, run_id=scheduled__2024-04-03T02:43:00+00:00, run_start_date=2024-04-03 02:44:01.023100+00:00, run_end_date=2024-04-03 02:44:06.919912+00:00, run_duration=5.896812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:43:00+00:00, data_interval_end=2024-04-03 02:44:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:44:06.932230820Z [2024-04-03T02:44:06.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:44:00+00:00, run_after=2024-04-03T02:45:00+00:00 2024-04-03T02:44:06.938373745Z [2024-04-03T02:44:06.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:44:06.938782035Z [2024-04-03T02:44:06.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:43:00+00:00, run_id=scheduled__2024-04-03T02:43:00+00:00, run_start_date=2024-04-03 02:44:01.020972+00:00, run_end_date=2024-04-03 02:44:06.938309+00:00, run_duration=5.917337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:43:00+00:00, data_interval_end=2024-04-03 02:44:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:44:06.948763283Z [2024-04-03T02:44:06.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:44:00+00:00, run_after=2024-04-03T02:45:00+00:00 2024-04-03T02:44:06.987353609Z [2024-04-03T02:44:06.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:43:00+00:00 exited with status success for try_number 1 2024-04-03T02:44:06.987798144Z [2024-04-03T02:44:06.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:43:00+00:00 exited with status success for try_number 1 2024-04-03T02:44:06.996758576Z [2024-04-03T02:44:06.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:43:00+00:00, map_index=-1, run_start_date=2024-04-03 02:44:03.614908+00:00, run_end_date=2024-04-03 02:44:06.182402+00:00, run_duration=2.567494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:44:01.092198+00:00, queued_by_job_id=1, pid=6019 2024-04-03T02:44:06.997520209Z [2024-04-03T02:44:06.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:43:00+00:00, map_index=-1, run_start_date=2024-04-03 02:44:03.507061+00:00, run_end_date=2024-04-03 02:44:05.857519+00:00, run_duration=2.350458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:44:01.092198+00:00, queued_by_job_id=1, pid=6018 2024-04-03T02:45:00.282959685Z [2024-04-03T02:45:00.281+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:45:00.308986762Z [2024-04-03T02:45:00.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:45:00+00:00, run_after=2024-04-03T02:50:00+00:00 2024-04-03T02:45:00.325914129Z [2024-04-03T02:45:00.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:45:00+00:00, run_after=2024-04-03T02:46:00+00:00 2024-04-03T02:45:00.419534280Z [2024-04-03T02:45:00.419+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:45:00.419559939Z 2024-04-03T02:45:00.419563894Z 2024-04-03T02:45:00.419567386Z 2024-04-03T02:45:00.419576548Z [2024-04-03T02:45:00.419+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:45:00.419636977Z [2024-04-03T02:45:00.419+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:45:00.419713895Z [2024-04-03T02:45:00.419+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:45:00.420266433Z [2024-04-03T02:45:00.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:45:00.420277958Z 2024-04-03T02:45:00.420281566Z 2024-04-03T02:45:00.420284642Z 2024-04-03T02:45:00.423263680Z [2024-04-03T02:45:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:45:00.423372907Z [2024-04-03T02:45:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:45:00.423535516Z [2024-04-03T02:45:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:45:00.423611597Z [2024-04-03T02:45:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:45:00.423788984Z [2024-04-03T02:45:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:45:00.423859260Z [2024-04-03T02:45:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:45:00.894602087Z [2024-04-03T02:45:00.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status queued for try_number 1 2024-04-03T02:45:00.894736192Z [2024-04-03T02:45:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:44:00+00:00 exited with status queued for try_number 1 2024-04-03T02:45:00.894792750Z [2024-04-03T02:45:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:44:00+00:00 exited with status queued for try_number 1 2024-04-03T02:45:00.908694931Z [2024-04-03T02:45:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41620cf5-20a5-47e3-aa05-808945f52b29 2024-04-03T02:45:00.908784116Z [2024-04-03T02:45:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82475bf8-dc70-4a41-9fc7-3d2e54663225 2024-04-03T02:45:00.908878033Z [2024-04-03T02:45:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5446ab7-e77b-44f4-bfab-565289d69239 2024-04-03T02:45:04.703428145Z [2024-04-03T02:45:04.702+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:45:04.703486183Z 2024-04-03T02:45:04.703506129Z [2024-04-03T02:45:04.703+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:45:04.704401669Z [2024-04-03T02:45:04.704+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:45:04.704414465Z 2024-04-03T02:45:04.708260624Z [2024-04-03T02:45:04.707+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:45:04.708618321Z [2024-04-03T02:45:04.708+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:45:04.761837069Z [2024-04-03T02:45:04.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status queued for try_number 1 2024-04-03T02:45:04.761890011Z [2024-04-03T02:45:04.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status success for try_number 1 2024-04-03T02:45:04.768242559Z [2024-04-03T02:45:04.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 600ba66b-f47c-4fcd-8ed5-12dfd808f95d 2024-04-03T02:45:04.768295194Z [2024-04-03T02:45:04.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:40:00+00:00, map_index=-1, run_start_date=2024-04-03 02:45:03.396456+00:00, run_end_date=2024-04-03 02:45:03.946975+00:00, run_duration=0.550519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:45:00.420877+00:00, queued_by_job_id=1, pid=6076 2024-04-03T02:45:05.937638027Z [2024-04-03T02:45:05.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:45:05.938261530Z [2024-04-03T02:45:05.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:44:00+00:00, run_id=scheduled__2024-04-03T02:44:00+00:00, run_start_date=2024-04-03 02:45:00.352414+00:00, run_end_date=2024-04-03 02:45:05.937494+00:00, run_duration=5.58508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:44:00+00:00, data_interval_end=2024-04-03 02:45:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:45:05.948172728Z [2024-04-03T02:45:05.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:45:00+00:00, run_after=2024-04-03T02:46:00+00:00 2024-04-03T02:45:05.954604148Z [2024-04-03T02:45:05.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:45:05.954903475Z [2024-04-03T02:45:05.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:44:00+00:00, run_id=scheduled__2024-04-03T02:44:00+00:00, run_start_date=2024-04-03 02:45:00.357611+00:00, run_end_date=2024-04-03 02:45:05.954456+00:00, run_duration=5.596845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:44:00+00:00, data_interval_end=2024-04-03 02:45:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:45:05.963462460Z [2024-04-03T02:45:05.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:45:00+00:00, run_after=2024-04-03T02:46:00+00:00 2024-04-03T02:45:06.016122676Z [2024-04-03T02:45:06.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:44:00+00:00 exited with status success for try_number 1 2024-04-03T02:45:06.016849836Z [2024-04-03T02:45:06.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:44:00+00:00 exited with status success for try_number 1 2024-04-03T02:45:06.027722520Z [2024-04-03T02:45:06.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:44:00+00:00, map_index=-1, run_start_date=2024-04-03 02:45:04.048735+00:00, run_end_date=2024-04-03 02:45:05.719249+00:00, run_duration=1.670514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:45:00.420877+00:00, queued_by_job_id=1, pid=6104 2024-04-03T02:45:06.028256234Z [2024-04-03T02:45:06.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:44:00+00:00, map_index=-1, run_start_date=2024-04-03 02:45:03.275587+00:00, run_end_date=2024-04-03 02:45:04.811332+00:00, run_duration=1.535745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:45:00.420877+00:00, queued_by_job_id=1, pid=6075 2024-04-03T02:45:07.113646169Z [2024-04-03T02:45:07.113+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:45:07.113691684Z 2024-04-03T02:45:07.113945270Z [2024-04-03T02:45:07.113+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:45:07.114736165Z [2024-04-03T02:45:07.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:45:07.114768132Z 2024-04-03T02:45:07.117364327Z [2024-04-03T02:45:07.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:45:07.117439318Z [2024-04-03T02:45:07.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:45:07.183370282Z [2024-04-03T02:45:07.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status queued for try_number 1 2024-04-03T02:45:07.183396592Z [2024-04-03T02:45:07.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status success for try_number 1 2024-04-03T02:45:07.200078576Z [2024-04-03T02:45:07.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to 508cb96d-912a-4a31-b9b2-aaaf72d851af 2024-04-03T02:45:07.200540847Z [2024-04-03T02:45:07.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:40:00+00:00, map_index=-1, run_start_date=2024-04-03 02:45:06.456709+00:00, run_end_date=2024-04-03 02:45:06.838821+00:00, run_duration=0.382112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:45:04.704933+00:00, queued_by_job_id=1, pid=6125 2024-04-03T02:45:09.293092765Z [2024-04-03T02:45:09.292+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:45:09.293125652Z 2024-04-03T02:45:09.293137967Z [2024-04-03T02:45:09.292+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:45:09.293967903Z [2024-04-03T02:45:09.293+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:45:09.293986409Z 2024-04-03T02:45:09.296174219Z [2024-04-03T02:45:09.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:45:09.296420629Z [2024-04-03T02:45:09.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:45:09.339949732Z [2024-04-03T02:45:09.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status queued for try_number 1 2024-04-03T02:45:09.340100541Z [2024-04-03T02:45:09.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status success for try_number 1 2024-04-03T02:45:09.347207402Z [2024-04-03T02:45:09.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a2e3ce8-1c4b-45d1-8689-f76e12ac57d9 2024-04-03T02:45:09.347611137Z [2024-04-03T02:45:09.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:40:00+00:00, map_index=0, run_start_date=2024-04-03 02:45:08.760498+00:00, run_end_date=2024-04-03 02:45:09.124988+00:00, run_duration=0.36449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:45:07.115096+00:00, queued_by_job_id=1, pid=6137 2024-04-03T02:45:11.530109016Z [2024-04-03T02:45:11.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:45:11.530449881Z [2024-04-03T02:45:11.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:40:00+00:00, run_id=scheduled__2024-04-03T02:40:00+00:00, run_start_date=2024-04-03 02:45:00.349984+00:00, run_end_date=2024-04-03 02:45:11.530122+00:00, run_duration=11.180138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:40:00+00:00, data_interval_end=2024-04-03 02:45:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:45:11.537001262Z [2024-04-03T02:45:11.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:45:00+00:00, run_after=2024-04-03T02:50:00+00:00 2024-04-03T02:45:11.579051236Z [2024-04-03T02:45:11.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:40:00+00:00 exited with status success for try_number 1 2024-04-03T02:45:11.584000321Z [2024-04-03T02:45:11.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:40:00+00:00, map_index=-1, run_start_date=2024-04-03 02:45:11.109178+00:00, run_end_date=2024-04-03 02:45:11.417787+00:00, run_duration=0.308609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:45:09.294210+00:00, queued_by_job_id=1, pid=6149 2024-04-03T02:46:00.667073932Z [2024-04-03T02:46:00.666+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:46:00+00:00, run_after=2024-04-03T02:47:00+00:00 2024-04-03T02:46:00.676657631Z [2024-04-03T02:46:00.676+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:46:00.683457471Z [2024-04-03T02:46:00.683+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:46:00.787657178Z [2024-04-03T02:46:00.777+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:46:00.787686082Z 2024-04-03T02:46:00.787690772Z 2024-04-03T02:46:00.787694279Z 2024-04-03T02:46:00.787700621Z [2024-04-03T02:46:00.783+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:46:00.787704443Z [2024-04-03T02:46:00.783+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:46:00.787707766Z [2024-04-03T02:46:00.783+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:46:00.787711194Z [2024-04-03T02:46:00.784+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:46:00.787714322Z 2024-04-03T02:46:00.787718040Z 2024-04-03T02:46:00.787721481Z 2024-04-03T02:46:00.793961312Z [2024-04-03T02:46:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:46:00.794016760Z [2024-04-03T02:46:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:46:00.794021830Z [2024-04-03T02:46:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:46:00.794025058Z [2024-04-03T02:46:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:46:00.794028428Z [2024-04-03T02:46:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:46:00.794031635Z [2024-04-03T02:46:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:46:01.103459642Z [2024-04-03T02:46:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:44:00+00:00 exited with status queued for try_number 1 2024-04-03T02:46:01.103510929Z [2024-04-03T02:46:01.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:46:01.103595157Z [2024-04-03T02:46:01.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:46:01.118362666Z [2024-04-03T02:46:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7751c598-372e-4462-afe6-92300426a975 2024-04-03T02:46:01.118407818Z [2024-04-03T02:46:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75bb5455-fa18-4242-b543-8fd034fc0d1f 2024-04-03T02:46:01.118620479Z [2024-04-03T02:46:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to bae816e7-2b52-4027-91ed-9f1ec40ae8c9 2024-04-03T02:46:03.436884445Z [2024-04-03T02:46:03.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:46:03.440768695Z [2024-04-03T02:46:03.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:44:00+00:00, run_id=scheduled__2024-04-03T02:44:00+00:00, run_start_date=2024-04-03 02:46:00.696848+00:00, run_end_date=2024-04-03 02:46:03.440126+00:00, run_duration=2.743278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:44:00+00:00, data_interval_end=2024-04-03 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:46:03.454133816Z [2024-04-03T02:46:03.453+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:46:00+00:00, run_after=2024-04-03T02:48:00+00:00 2024-04-03T02:46:03.518840402Z [2024-04-03T02:46:03.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:44:00+00:00 exited with status success for try_number 1 2024-04-03T02:46:03.528211501Z [2024-04-03T02:46:03.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:44:00+00:00, map_index=-1, run_start_date=2024-04-03 02:46:01.936720+00:00, run_end_date=2024-04-03 02:46:02.390413+00:00, run_duration=0.453693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:46:00.785329+00:00, queued_by_job_id=1, pid=6167 2024-04-03T02:46:05.516218944Z [2024-04-03T02:46:05.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:46:05.516415756Z [2024-04-03T02:46:05.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:45:00+00:00, run_id=scheduled__2024-04-03T02:45:00+00:00, run_start_date=2024-04-03 02:46:00.699926+00:00, run_end_date=2024-04-03 02:46:05.516023+00:00, run_duration=4.816097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:45:00+00:00, data_interval_end=2024-04-03 02:46:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:46:05.529507541Z [2024-04-03T02:46:05.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:46:00+00:00, run_after=2024-04-03T02:47:00+00:00 2024-04-03T02:46:05.577949640Z [2024-04-03T02:46:05.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:46:05.584221341Z [2024-04-03T02:46:05.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=-1, run_start_date=2024-04-03 02:46:03.137698+00:00, run_end_date=2024-04-03 02:46:05.259409+00:00, run_duration=2.121711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:46:00.785329+00:00, queued_by_job_id=1, pid=6197 2024-04-03T02:46:06.624162793Z [2024-04-03T02:46:06.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:46:06.624226735Z [2024-04-03T02:46:06.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:45:00+00:00, run_id=scheduled__2024-04-03T02:45:00+00:00, run_start_date=2024-04-03 02:46:00.702970+00:00, run_end_date=2024-04-03 02:46:06.623726+00:00, run_duration=5.920756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:45:00+00:00, data_interval_end=2024-04-03 02:46:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:46:06.634939281Z [2024-04-03T02:46:06.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:46:00+00:00, run_after=2024-04-03T02:47:00+00:00 2024-04-03T02:46:06.716204806Z [2024-04-03T02:46:06.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:46:06.725907273Z [2024-04-03T02:46:06.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=-1, run_start_date=2024-04-03 02:46:03.427375+00:00, run_end_date=2024-04-03 02:46:05.658223+00:00, run_duration=2.230848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:46:00.785329+00:00, queued_by_job_id=1, pid=6198 2024-04-03T02:46:35.642055473Z [2024-04-03T02:46:35.641+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:47:00.234367695Z [2024-04-03T02:47:00.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:47:00+00:00, run_after=2024-04-03T02:48:00+00:00 2024-04-03T02:47:00.247564304Z [2024-04-03T02:47:00.247+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:47:00.299995982Z [2024-04-03T02:47:00.299+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:47:00.300017218Z 2024-04-03T02:47:00.300020785Z 2024-04-03T02:47:00.300364190Z [2024-04-03T02:47:00.299+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:47:00.300562799Z [2024-04-03T02:47:00.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:47:00.301437845Z [2024-04-03T02:47:00.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:47:00.301449279Z 2024-04-03T02:47:00.301452699Z 2024-04-03T02:47:00.305281849Z [2024-04-03T02:47:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:47:00.305470729Z [2024-04-03T02:47:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:47:00.305719723Z [2024-04-03T02:47:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:47:00.305820029Z [2024-04-03T02:47:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:47:00.524601324Z [2024-04-03T02:47:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:46:00+00:00 exited with status queued for try_number 1 2024-04-03T02:47:00.524629025Z [2024-04-03T02:47:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:46:00+00:00 exited with status queued for try_number 1 2024-04-03T02:47:00.532051896Z [2024-04-03T02:47:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6cbfad3-a023-4994-9d05-832713107f45 2024-04-03T02:47:00.532188720Z [2024-04-03T02:47:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9da85563-01ca-4d0a-8657-3f58eb43b572 2024-04-03T02:47:04.042439490Z [2024-04-03T02:47:04.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:47:04.042655453Z [2024-04-03T02:47:04.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:46:00+00:00, run_id=scheduled__2024-04-03T02:46:00+00:00, run_start_date=2024-04-03 02:47:00.258123+00:00, run_end_date=2024-04-03 02:47:04.042341+00:00, run_duration=3.784218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:46:00+00:00, data_interval_end=2024-04-03 02:47:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:47:04.053567701Z [2024-04-03T02:47:04.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:47:00+00:00, run_after=2024-04-03T02:48:00+00:00 2024-04-03T02:47:04.100233812Z [2024-04-03T02:47:04.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:46:00+00:00 exited with status success for try_number 1 2024-04-03T02:47:04.105072661Z [2024-04-03T02:47:04.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:46:00+00:00, map_index=-1, run_start_date=2024-04-03 02:47:02.522541+00:00, run_end_date=2024-04-03 02:47:03.844089+00:00, run_duration=1.321548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:47:00.302411+00:00, queued_by_job_id=1, pid=6252 2024-04-03T02:47:05.168242366Z [2024-04-03T02:47:05.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:47:05.168508864Z [2024-04-03T02:47:05.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:46:00+00:00, run_id=scheduled__2024-04-03T02:46:00+00:00, run_start_date=2024-04-03 02:47:00.259750+00:00, run_end_date=2024-04-03 02:47:05.168047+00:00, run_duration=4.908297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:46:00+00:00, data_interval_end=2024-04-03 02:47:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:47:05.180179424Z [2024-04-03T02:47:05.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:47:00+00:00, run_after=2024-04-03T02:48:00+00:00 2024-04-03T02:47:05.224482893Z [2024-04-03T02:47:05.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:46:00+00:00 exited with status success for try_number 1 2024-04-03T02:47:05.232820947Z [2024-04-03T02:47:05.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:46:00+00:00, map_index=-1, run_start_date=2024-04-03 02:47:02.605230+00:00, run_end_date=2024-04-03 02:47:04.254211+00:00, run_duration=1.648981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:47:00.302411+00:00, queued_by_job_id=1, pid=6253 2024-04-03T02:48:00.263590648Z [2024-04-03T02:48:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:48:00+00:00, run_after=2024-04-03T02:49:00+00:00 2024-04-03T02:48:00.271342439Z [2024-04-03T02:48:00.270+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:48:00.277883547Z [2024-04-03T02:48:00.277+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:48:00.346128708Z [2024-04-03T02:48:00.345+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:48:00.346159519Z 2024-04-03T02:48:00.346165628Z 2024-04-03T02:48:00.346170619Z 2024-04-03T02:48:00.346236168Z [2024-04-03T02:48:00.346+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:48:00.346371893Z [2024-04-03T02:48:00.346+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:48:00.346488044Z [2024-04-03T02:48:00.346+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:48:00.347141404Z [2024-04-03T02:48:00.346+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:48:00.347155685Z 2024-04-03T02:48:00.347160923Z 2024-04-03T02:48:00.347165762Z 2024-04-03T02:48:00.350228567Z [2024-04-03T02:48:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:48:00.353977798Z [2024-04-03T02:48:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:48:00.354252641Z [2024-04-03T02:48:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:48:00.354377136Z [2024-04-03T02:48:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:48:00.354643042Z [2024-04-03T02:48:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:48:00.354778212Z [2024-04-03T02:48:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:48:00.641643734Z [2024-04-03T02:48:00.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:46:00+00:00 exited with status queued for try_number 1 2024-04-03T02:48:00.642937832Z [2024-04-03T02:48:00.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:47:00+00:00 exited with status queued for try_number 1 2024-04-03T02:48:00.643141318Z [2024-04-03T02:48:00.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:47:00+00:00 exited with status queued for try_number 1 2024-04-03T02:48:00.658176821Z [2024-04-03T02:48:00.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to b70c798a-2b54-46ef-8205-af3c0acd3d9d 2024-04-03T02:48:00.658486499Z [2024-04-03T02:48:00.658+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d1a7db6-0fca-4273-b0a1-0079b04c337c 2024-04-03T02:48:00.658850937Z [2024-04-03T02:48:00.658+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ca6795c-5fc9-4e2f-bbcd-5f16ff201086 2024-04-03T02:48:02.661434849Z [2024-04-03T02:48:02.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:48:02.662274766Z [2024-04-03T02:48:02.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:46:00+00:00, run_id=scheduled__2024-04-03T02:46:00+00:00, run_start_date=2024-04-03 02:48:00.287172+00:00, run_end_date=2024-04-03 02:48:02.661812+00:00, run_duration=2.37464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:46:00+00:00, data_interval_end=2024-04-03 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:48:02.670879222Z [2024-04-03T02:48:02.670+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:48:00+00:00, run_after=2024-04-03T02:50:00+00:00 2024-04-03T02:48:02.729728596Z [2024-04-03T02:48:02.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:46:00+00:00 exited with status success for try_number 1 2024-04-03T02:48:02.740524824Z [2024-04-03T02:48:02.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:46:00+00:00, map_index=-1, run_start_date=2024-04-03 02:48:01.480099+00:00, run_end_date=2024-04-03 02:48:01.888857+00:00, run_duration=0.408758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:48:00.347778+00:00, queued_by_job_id=1, pid=6288 2024-04-03T02:48:04.861056691Z [2024-04-03T02:48:04.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:48:04.861929974Z [2024-04-03T02:48:04.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:47:00+00:00, run_id=scheduled__2024-04-03T02:47:00+00:00, run_start_date=2024-04-03 02:48:00.288423+00:00, run_end_date=2024-04-03 02:48:04.861297+00:00, run_duration=4.572874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:47:00+00:00, data_interval_end=2024-04-03 02:48:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:48:04.879899262Z [2024-04-03T02:48:04.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:48:00+00:00, run_after=2024-04-03T02:49:00+00:00 2024-04-03T02:48:04.888246919Z [2024-04-03T02:48:04.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:48:04.888761539Z [2024-04-03T02:48:04.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:47:00+00:00, run_id=scheduled__2024-04-03T02:47:00+00:00, run_start_date=2024-04-03 02:48:00.289402+00:00, run_end_date=2024-04-03 02:48:04.888435+00:00, run_duration=4.599033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:47:00+00:00, data_interval_end=2024-04-03 02:48:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:48:04.898563191Z [2024-04-03T02:48:04.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:48:00+00:00, run_after=2024-04-03T02:49:00+00:00 2024-04-03T02:48:04.930959314Z [2024-04-03T02:48:04.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:47:00+00:00 exited with status success for try_number 1 2024-04-03T02:48:04.931252594Z [2024-04-03T02:48:04.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:47:00+00:00 exited with status success for try_number 1 2024-04-03T02:48:04.938471902Z [2024-04-03T02:48:04.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:47:00+00:00, map_index=-1, run_start_date=2024-04-03 02:48:02.736840+00:00, run_end_date=2024-04-03 02:48:03.957518+00:00, run_duration=1.220678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:48:00.347778+00:00, queued_by_job_id=1, pid=6318 2024-04-03T02:48:04.938832948Z [2024-04-03T02:48:04.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:47:00+00:00, map_index=-1, run_start_date=2024-04-03 02:48:02.747239+00:00, run_end_date=2024-04-03 02:48:04.410291+00:00, run_duration=1.663052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:48:00.347778+00:00, queued_by_job_id=1, pid=6319 2024-04-03T02:49:00.521398453Z [2024-04-03T02:49:00.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:49:00+00:00, run_after=2024-04-03T02:50:00+00:00 2024-04-03T02:49:00.530942170Z [2024-04-03T02:49:00.530+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:49:00.592622160Z [2024-04-03T02:49:00.592+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:49:00.592654541Z 2024-04-03T02:49:00.592659761Z 2024-04-03T02:49:00.592664041Z [2024-04-03T02:49:00.592+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:49:00.592764268Z [2024-04-03T02:49:00.592+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:49:00.593366718Z [2024-04-03T02:49:00.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:49:00.593380896Z 2024-04-03T02:49:00.593384613Z 2024-04-03T02:49:00.596134591Z [2024-04-03T02:49:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:49:00.596317340Z [2024-04-03T02:49:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:49:00.596561834Z [2024-04-03T02:49:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:49:00.596712101Z [2024-04-03T02:49:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:49:00.935406574Z [2024-04-03T02:49:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:48:00+00:00 exited with status queued for try_number 1 2024-04-03T02:49:00.935439447Z [2024-04-03T02:49:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:48:00+00:00 exited with status queued for try_number 1 2024-04-03T02:49:00.944524403Z [2024-04-03T02:49:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd0f1d79-c303-4317-b9bc-01518f6f32e8 2024-04-03T02:49:00.944590869Z [2024-04-03T02:49:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 565bdb84-35a5-4072-b8d1-5e3b499fd5f9 2024-04-03T02:49:04.635079086Z [2024-04-03T02:49:04.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:49:04.635739905Z [2024-04-03T02:49:04.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:48:00+00:00, run_id=scheduled__2024-04-03T02:48:00+00:00, run_start_date=2024-04-03 02:49:00.544861+00:00, run_end_date=2024-04-03 02:49:04.634997+00:00, run_duration=4.090136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:48:00+00:00, data_interval_end=2024-04-03 02:49:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:49:04.653976253Z [2024-04-03T02:49:04.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:49:00+00:00, run_after=2024-04-03T02:50:00+00:00 2024-04-03T02:49:04.662679345Z [2024-04-03T02:49:04.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:49:04.663246276Z [2024-04-03T02:49:04.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:48:00+00:00, run_id=scheduled__2024-04-03T02:48:00+00:00, run_start_date=2024-04-03 02:49:00.547575+00:00, run_end_date=2024-04-03 02:49:04.662412+00:00, run_duration=4.114837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:48:00+00:00, data_interval_end=2024-04-03 02:49:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:49:04.673199620Z [2024-04-03T02:49:04.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:49:00+00:00, run_after=2024-04-03T02:50:00+00:00 2024-04-03T02:49:04.723886203Z [2024-04-03T02:49:04.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:48:00+00:00 exited with status success for try_number 1 2024-04-03T02:49:04.724094521Z [2024-04-03T02:49:04.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:48:00+00:00 exited with status success for try_number 1 2024-04-03T02:49:04.730405519Z [2024-04-03T02:49:04.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:48:00+00:00, map_index=-1, run_start_date=2024-04-03 02:49:02.950865+00:00, run_end_date=2024-04-03 02:49:04.485201+00:00, run_duration=1.534336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:49:00.593837+00:00, queued_by_job_id=1, pid=6374 2024-04-03T02:49:04.730790850Z [2024-04-03T02:49:04.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:48:00+00:00, map_index=-1, run_start_date=2024-04-03 02:49:02.651805+00:00, run_end_date=2024-04-03 02:49:04.433880+00:00, run_duration=1.782075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:49:00.593837+00:00, queued_by_job_id=1, pid=6364 2024-04-03T02:50:00.408842096Z [2024-04-03T02:50:00.408+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:50:00.418232565Z [2024-04-03T02:50:00.417+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:50:00.436320533Z [2024-04-03T02:50:00.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:50:00+00:00, run_after=2024-04-03T02:51:00+00:00 2024-04-03T02:50:00.460996177Z [2024-04-03T02:50:00.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:50:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:50:00.560126009Z [2024-04-03T02:50:00.559+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T02:50:00.560169463Z 2024-04-03T02:50:00.560176712Z 2024-04-03T02:50:00.560183815Z 2024-04-03T02:50:00.560190763Z 2024-04-03T02:50:00.560208641Z [2024-04-03T02:50:00.559+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:50:00.560215937Z [2024-04-03T02:50:00.560+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:50:00.560319476Z [2024-04-03T02:50:00.560+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:50:00.560431070Z [2024-04-03T02:50:00.560+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:50:00.561169733Z [2024-04-03T02:50:00.560+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:50:00.561185374Z 2024-04-03T02:50:00.561206351Z 2024-04-03T02:50:00.561212844Z 2024-04-03T02:50:00.561218963Z 2024-04-03T02:50:00.565033193Z [2024-04-03T02:50:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:50:00.565186655Z [2024-04-03T02:50:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:50:00.565615809Z [2024-04-03T02:50:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:50:00.565689905Z [2024-04-03T02:50:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:50:00.565938279Z [2024-04-03T02:50:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:50:00.566041070Z [2024-04-03T02:50:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:50:00.566211989Z [2024-04-03T02:50:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:50:00.566231273Z [2024-04-03T02:50:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:50:01.229979178Z [2024-04-03T02:50:01.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:50:01.230342322Z [2024-04-03T02:50:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:48:00+00:00 exited with status queued for try_number 1 2024-04-03T02:50:01.231822987Z [2024-04-03T02:50:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:49:00+00:00 exited with status queued for try_number 1 2024-04-03T02:50:01.232010626Z [2024-04-03T02:50:01.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:49:00+00:00 exited with status queued for try_number 1 2024-04-03T02:50:01.249964541Z [2024-04-03T02:50:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5809c899-32b3-46e9-b803-2796629e7cce 2024-04-03T02:50:01.250199945Z [2024-04-03T02:50:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cbf6f37-55af-461f-9a02-538d26bf37c3 2024-04-03T02:50:01.250407221Z [2024-04-03T02:50:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff2ae5d4-bcdf-469d-a480-b9a965c31513 2024-04-03T02:50:01.250697412Z [2024-04-03T02:50:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43379fba-7024-44c9-8df5-b955dd852f0b 2024-04-03T02:50:03.405387690Z [2024-04-03T02:50:03.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:50:03.405822596Z [2024-04-03T02:50:03.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:48:00+00:00, run_id=scheduled__2024-04-03T02:48:00+00:00, run_start_date=2024-04-03 02:50:00.474722+00:00, run_end_date=2024-04-03 02:50:03.405177+00:00, run_duration=2.930455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:48:00+00:00, data_interval_end=2024-04-03 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:50:03.413670822Z [2024-04-03T02:50:03.413+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:50:00+00:00, run_after=2024-04-03T02:52:00+00:00 2024-04-03T02:50:03.550366326Z [2024-04-03T02:50:03.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:48:00+00:00 exited with status success for try_number 1 2024-04-03T02:50:03.571303096Z [2024-04-03T02:50:03.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:48:00+00:00, map_index=-1, run_start_date=2024-04-03 02:50:02.265253+00:00, run_end_date=2024-04-03 02:50:02.759370+00:00, run_duration=0.494117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:50:00.561912+00:00, queued_by_job_id=1, pid=6412 2024-04-03T02:50:04.709599668Z [2024-04-03T02:50:04.709+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:50:04.709669397Z 2024-04-03T02:50:04.709786011Z [2024-04-03T02:50:04.709+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:50:04.710752163Z [2024-04-03T02:50:04.710+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:50:04.710775110Z 2024-04-03T02:50:04.714427171Z [2024-04-03T02:50:04.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:50:04.714736599Z [2024-04-03T02:50:04.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:50:04.788371087Z [2024-04-03T02:50:04.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:50:04.788410399Z [2024-04-03T02:50:04.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:50:04.796402500Z [2024-04-03T02:50:04.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ba2b3de-66c0-4df7-a1f1-d315d90f36db 2024-04-03T02:50:04.796921353Z [2024-04-03T02:50:04.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=-1, run_start_date=2024-04-03 02:50:03.240581+00:00, run_end_date=2024-04-03 02:50:03.907350+00:00, run_duration=0.666769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:50:00.561912+00:00, queued_by_job_id=1, pid=6441 2024-04-03T02:50:05.946670233Z [2024-04-03T02:50:05.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:50:05.946726464Z [2024-04-03T02:50:05.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:49:00+00:00, run_id=scheduled__2024-04-03T02:49:00+00:00, run_start_date=2024-04-03 02:50:00.475995+00:00, run_end_date=2024-04-03 02:50:05.946337+00:00, run_duration=5.470342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:49:00+00:00, data_interval_end=2024-04-03 02:50:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:50:05.955501869Z [2024-04-03T02:50:05.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:50:00+00:00, run_after=2024-04-03T02:51:00+00:00 2024-04-03T02:50:05.962797716Z [2024-04-03T02:50:05.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:50:05.963090149Z [2024-04-03T02:50:05.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:49:00+00:00, run_id=scheduled__2024-04-03T02:49:00+00:00, run_start_date=2024-04-03 02:50:00.477319+00:00, run_end_date=2024-04-03 02:50:05.962619+00:00, run_duration=5.4853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:49:00+00:00, data_interval_end=2024-04-03 02:50:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:50:05.972322326Z [2024-04-03T02:50:05.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:50:00+00:00, run_after=2024-04-03T02:51:00+00:00 2024-04-03T02:50:06.042067226Z [2024-04-03T02:50:06.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:49:00+00:00 exited with status success for try_number 1 2024-04-03T02:50:06.042301052Z [2024-04-03T02:50:06.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:49:00+00:00 exited with status success for try_number 1 2024-04-03T02:50:06.051089688Z [2024-04-03T02:50:06.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:49:00+00:00, map_index=-1, run_start_date=2024-04-03 02:50:03.470469+00:00, run_end_date=2024-04-03 02:50:04.924033+00:00, run_duration=1.453564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:50:00.561912+00:00, queued_by_job_id=1, pid=6442 2024-04-03T02:50:06.051193839Z [2024-04-03T02:50:06.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:49:00+00:00, map_index=-1, run_start_date=2024-04-03 02:50:04.215028+00:00, run_end_date=2024-04-03 02:50:05.818235+00:00, run_duration=1.603207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:50:00.561912+00:00, queued_by_job_id=1, pid=6470 2024-04-03T02:50:07.122341317Z [2024-04-03T02:50:07.121+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:50:07.122402912Z 2024-04-03T02:50:07.122413031Z [2024-04-03T02:50:07.122+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:50:07.123339703Z [2024-04-03T02:50:07.123+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:50:07.123381676Z 2024-04-03T02:50:07.126644529Z [2024-04-03T02:50:07.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:50:07.126743022Z [2024-04-03T02:50:07.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:50:07.190190942Z [2024-04-03T02:50:07.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:50:07.190440085Z [2024-04-03T02:50:07.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:50:07.198646378Z [2024-04-03T02:50:07.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee10f40c-d5d7-4684-8517-5463717eaee6 2024-04-03T02:50:07.199077122Z [2024-04-03T02:50:07.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=-1, run_start_date=2024-04-03 02:50:06.432202+00:00, run_end_date=2024-04-03 02:50:06.845332+00:00, run_duration=0.41313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:50:04.711240+00:00, queued_by_job_id=1, pid=6491 2024-04-03T02:50:09.795018880Z [2024-04-03T02:50:09.794+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:50:09.795049386Z 2024-04-03T02:50:09.795054818Z [2024-04-03T02:50:09.794+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:50:09.798337762Z [2024-04-03T02:50:09.795+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:50:09.798360241Z 2024-04-03T02:50:09.798364805Z [2024-04-03T02:50:09.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:50:09.798368781Z [2024-04-03T02:50:09.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:50:09.883739076Z [2024-04-03T02:50:09.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:50:09.884824892Z [2024-04-03T02:50:09.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:50:09.898076579Z [2024-04-03T02:50:09.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5914b6b-1400-4897-82ac-885e95023a91 2024-04-03T02:50:09.898495553Z [2024-04-03T02:50:09.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=0, run_start_date=2024-04-03 02:50:08.751623+00:00, run_end_date=2024-04-03 02:50:09.094203+00:00, run_duration=0.34258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:50:07.123790+00:00, queued_by_job_id=1, pid=6503 2024-04-03T02:50:12.648388923Z [2024-04-03T02:50:12.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:50:12.648878047Z [2024-04-03T02:50:12.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:45:00+00:00, run_id=scheduled__2024-04-03T02:45:00+00:00, run_start_date=2024-04-03 02:50:00.472783+00:00, run_end_date=2024-04-03 02:50:12.648294+00:00, run_duration=12.175511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:45:00+00:00, data_interval_end=2024-04-03 02:50:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:50:12.657231768Z [2024-04-03T02:50:12.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:50:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:50:12.688428366Z [2024-04-03T02:50:12.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:50:12.695480869Z [2024-04-03T02:50:12.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=-1, run_start_date=2024-04-03 02:50:11.670002+00:00, run_end_date=2024-04-03 02:50:12.061881+00:00, run_duration=0.391879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:50:09.795660+00:00, queued_by_job_id=1, pid=6515 2024-04-03T02:51:00.408424699Z [2024-04-03T02:51:00.407+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:51:00.422791473Z [2024-04-03T02:51:00.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:51:00+00:00, run_after=2024-04-03T02:52:00+00:00 2024-04-03T02:51:00.497617675Z [2024-04-03T02:51:00.497+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:51:00.497687184Z 2024-04-03T02:51:00.497691408Z 2024-04-03T02:51:00.497991006Z [2024-04-03T02:51:00.497+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:51:00.498169519Z [2024-04-03T02:51:00.498+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:51:00.498899642Z [2024-04-03T02:51:00.498+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:51:00.498913798Z 2024-04-03T02:51:00.498918542Z 2024-04-03T02:51:00.501752317Z [2024-04-03T02:51:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:51:00.502033657Z [2024-04-03T02:51:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:51:00.502351297Z [2024-04-03T02:51:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:51:00.502538231Z [2024-04-03T02:51:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:51:00.850056838Z [2024-04-03T02:51:00.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status queued for try_number 1 2024-04-03T02:51:00.850365183Z [2024-04-03T02:51:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status queued for try_number 1 2024-04-03T02:51:00.867730893Z [2024-04-03T02:51:00.867+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a96159c-1453-401e-9113-e7494cafa53c 2024-04-03T02:51:00.871066878Z [2024-04-03T02:51:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81433a5c-d468-4211-abdf-f95e416b8e30 2024-04-03T02:51:04.013260809Z [2024-04-03T02:51:04.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:51:04.013796966Z [2024-04-03T02:51:04.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:50:00+00:00, run_id=scheduled__2024-04-03T02:50:00+00:00, run_start_date=2024-04-03 02:51:00.453592+00:00, run_end_date=2024-04-03 02:51:04.013135+00:00, run_duration=3.559543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:50:00+00:00, data_interval_end=2024-04-03 02:51:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:51:04.023019066Z [2024-04-03T02:51:04.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:51:00+00:00, run_after=2024-04-03T02:52:00+00:00 2024-04-03T02:51:04.064819358Z [2024-04-03T02:51:04.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status success for try_number 1 2024-04-03T02:51:04.070304119Z [2024-04-03T02:51:04.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:50:00+00:00, map_index=-1, run_start_date=2024-04-03 02:51:02.413378+00:00, run_end_date=2024-04-03 02:51:03.696748+00:00, run_duration=1.28337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:51:00.499489+00:00, queued_by_job_id=1, pid=6551 2024-04-03T02:51:04.417140279Z [2024-04-03T02:51:04.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:51:04.417671195Z [2024-04-03T02:51:04.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:50:00+00:00, run_id=scheduled__2024-04-03T02:50:00+00:00, run_start_date=2024-04-03 02:51:00.455097+00:00, run_end_date=2024-04-03 02:51:04.417007+00:00, run_duration=3.96191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:50:00+00:00, data_interval_end=2024-04-03 02:51:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:51:04.427964849Z [2024-04-03T02:51:04.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:51:00+00:00, run_after=2024-04-03T02:52:00+00:00 2024-04-03T02:51:04.468816897Z [2024-04-03T02:51:04.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status success for try_number 1 2024-04-03T02:51:04.474006480Z [2024-04-03T02:51:04.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:50:00+00:00, map_index=-1, run_start_date=2024-04-03 02:51:02.434573+00:00, run_end_date=2024-04-03 02:51:04.133099+00:00, run_duration=1.698526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:51:00.499489+00:00, queued_by_job_id=1, pid=6552 2024-04-03T02:51:35.691413365Z [2024-04-03T02:51:35.690+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:52:00.196940191Z [2024-04-03T02:52:00.182+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:52:00.201022732Z [2024-04-03T02:52:00.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:52:00+00:00, run_after=2024-04-03T02:53:00+00:00 2024-04-03T02:52:00.207713429Z [2024-04-03T02:52:00.207+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:52:00.261335120Z [2024-04-03T02:52:00.260+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:52:00.261364814Z 2024-04-03T02:52:00.261370043Z 2024-04-03T02:52:00.261373436Z 2024-04-03T02:52:00.261384680Z [2024-04-03T02:52:00.261+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:52:00.261460093Z [2024-04-03T02:52:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:52:00.261512783Z [2024-04-03T02:52:00.261+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:52:00.262076616Z [2024-04-03T02:52:00.261+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:52:00.262105205Z 2024-04-03T02:52:00.262110681Z 2024-04-03T02:52:00.262115455Z 2024-04-03T02:52:00.265163810Z [2024-04-03T02:52:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:52:00.265263620Z [2024-04-03T02:52:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:52:00.265448106Z [2024-04-03T02:52:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:52:00.265531938Z [2024-04-03T02:52:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:52:00.265728155Z [2024-04-03T02:52:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:52:00.265804450Z [2024-04-03T02:52:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:52:00.699604647Z [2024-04-03T02:52:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status queued for try_number 1 2024-04-03T02:52:00.699653456Z [2024-04-03T02:52:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:51:00+00:00 exited with status queued for try_number 1 2024-04-03T02:52:00.699734502Z [2024-04-03T02:52:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:51:00+00:00 exited with status queued for try_number 1 2024-04-03T02:52:00.709955567Z [2024-04-03T02:52:00.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7ac9a03-9bb1-4a45-94a7-43f82bf35e21 2024-04-03T02:52:00.710083449Z [2024-04-03T02:52:00.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to abe0959c-beaf-4cfa-92d3-2f1882cfcc5f 2024-04-03T02:52:00.710185448Z [2024-04-03T02:52:00.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ea24bc1-8a5b-4c3f-81fa-07fb031dc73f 2024-04-03T02:52:01.934953176Z [2024-04-03T02:52:01.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:52:01.935226874Z [2024-04-03T02:52:01.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:50:00+00:00, run_id=scheduled__2024-04-03T02:50:00+00:00, run_start_date=2024-04-03 02:52:00.216395+00:00, run_end_date=2024-04-03 02:52:01.934882+00:00, run_duration=1.718487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:50:00+00:00, data_interval_end=2024-04-03 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:52:01.945202805Z [2024-04-03T02:52:01.944+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:52:00+00:00, run_after=2024-04-03T02:54:00+00:00 2024-04-03T02:52:01.990765005Z [2024-04-03T02:52:01.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status success for try_number 1 2024-04-03T02:52:01.997618871Z [2024-04-03T02:52:01.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:50:00+00:00, map_index=-1, run_start_date=2024-04-03 02:52:01.190577+00:00, run_end_date=2024-04-03 02:52:01.635102+00:00, run_duration=0.444525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:52:00.262806+00:00, queued_by_job_id=1, pid=6587 2024-04-03T02:52:04.389730199Z [2024-04-03T02:52:04.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:52:04.390310440Z [2024-04-03T02:52:04.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:51:00+00:00, run_id=scheduled__2024-04-03T02:51:00+00:00, run_start_date=2024-04-03 02:52:00.217542+00:00, run_end_date=2024-04-03 02:52:04.389908+00:00, run_duration=4.172366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:51:00+00:00, data_interval_end=2024-04-03 02:52:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:52:04.404992220Z [2024-04-03T02:52:04.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:52:00+00:00, run_after=2024-04-03T02:53:00+00:00 2024-04-03T02:52:04.459182335Z [2024-04-03T02:52:04.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:51:00+00:00 exited with status success for try_number 1 2024-04-03T02:52:04.466628066Z [2024-04-03T02:52:04.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:51:00+00:00, map_index=-1, run_start_date=2024-04-03 02:52:02.668830+00:00, run_end_date=2024-04-03 02:52:04.046765+00:00, run_duration=1.377935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:52:00.262806+00:00, queued_by_job_id=1, pid=6617 2024-04-03T02:52:05.502456239Z [2024-04-03T02:52:05.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:52:05.503113345Z [2024-04-03T02:52:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:51:00+00:00, run_id=scheduled__2024-04-03T02:51:00+00:00, run_start_date=2024-04-03 02:52:00.218551+00:00, run_end_date=2024-04-03 02:52:05.502674+00:00, run_duration=5.284123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:51:00+00:00, data_interval_end=2024-04-03 02:52:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:52:05.513464403Z [2024-04-03T02:52:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:52:00+00:00, run_after=2024-04-03T02:53:00+00:00 2024-04-03T02:52:05.554648563Z [2024-04-03T02:52:05.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:51:00+00:00 exited with status success for try_number 1 2024-04-03T02:52:05.561200380Z [2024-04-03T02:52:05.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:51:00+00:00, map_index=-1, run_start_date=2024-04-03 02:52:02.737653+00:00, run_end_date=2024-04-03 02:52:04.528546+00:00, run_duration=1.790893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:52:00.262806+00:00, queued_by_job_id=1, pid=6618 2024-04-03T02:52:24.523424746Z [2024-04-03T02:52:24.523+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:52:24.523454007Z 2024-04-03T02:52:24.523566110Z [2024-04-03T02:52:24.523+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-03T02:52:24.524192506Z [2024-04-03T02:52:24.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:52:24.524202980Z 2024-04-03T02:52:24.527174608Z [2024-04-03T02:52:24.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240403025223_537992', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:52:24.527357360Z [2024-04-03T02:52:24.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240403025223_537992', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-03T02:52:24.601881665Z [2024-04-03T02:52:24.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240403025223_537992 exited with status queued for try_number 1 2024-04-03T02:52:24.606680665Z [2024-04-03T02:52:24.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98bfbda1-8ca3-4da7-9f10-9b3b21b5507b 2024-04-03T02:52:25.723318183Z [2024-04-03T02:52:25.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:52:25.723527205Z [2024-04-03T02:52:25.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-03 02:52:23.868691+00:00, run_id=vdu_down_20240403025223_537992, run_start_date=2024-04-03 02:52:24.489686+00:00, run_end_date=2024-04-03 02:52:25.723240+00:00, run_duration=1.233554, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-03 02:52:23.868691+00:00, data_interval_end=2024-04-03 02:52:23.868691+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-03T02:52:25.726886996Z [2024-04-03T02:52:25.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-03T02:52:25.756734974Z [2024-04-03T02:52:25.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240403025223_537992 exited with status success for try_number 1 2024-04-03T02:52:25.761849753Z [2024-04-03T02:52:25.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240403025223_537992, map_index=-1, run_start_date=2024-04-03 02:52:25.235621+00:00, run_end_date=2024-04-03 02:52:25.586178+00:00, run_duration=0.350557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:52:24.524499+00:00, queued_by_job_id=1, pid=6651 2024-04-03T02:53:00.461701442Z [2024-04-03T02:53:00.461+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:53:00.479187122Z [2024-04-03T02:53:00.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:53:00+00:00, run_after=2024-04-03T02:54:00+00:00 2024-04-03T02:53:00.536227698Z [2024-04-03T02:53:00.535+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:53:00.536250878Z 2024-04-03T02:53:00.536254943Z 2024-04-03T02:53:00.536645527Z [2024-04-03T02:53:00.536+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:53:00.537079393Z [2024-04-03T02:53:00.536+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:53:00.540015581Z [2024-04-03T02:53:00.538+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:53:00.540031877Z 2024-04-03T02:53:00.540036189Z 2024-04-03T02:53:00.544182761Z [2024-04-03T02:53:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:53:00.544576393Z [2024-04-03T02:53:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:53:00.545088280Z [2024-04-03T02:53:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:53:00.545450695Z [2024-04-03T02:53:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:53:00.912459883Z [2024-04-03T02:53:00.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:52:00+00:00 exited with status queued for try_number 1 2024-04-03T02:53:00.912550209Z [2024-04-03T02:53:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:52:00+00:00 exited with status queued for try_number 1 2024-04-03T02:53:00.943278253Z [2024-04-03T02:53:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 045f1f97-5d3c-4839-bf37-ec717464a41f 2024-04-03T02:53:00.946391233Z [2024-04-03T02:53:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a408ab6-86b0-4e25-abe8-4fd0c6281ddf 2024-04-03T02:53:04.847241570Z [2024-04-03T02:53:04.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:53:04.847429354Z [2024-04-03T02:53:04.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:52:00+00:00, run_id=scheduled__2024-04-03T02:52:00+00:00, run_start_date=2024-04-03 02:53:00.492532+00:00, run_end_date=2024-04-03 02:53:04.847107+00:00, run_duration=4.354575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:52:00+00:00, data_interval_end=2024-04-03 02:53:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:53:04.856473552Z [2024-04-03T02:53:04.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:53:00+00:00, run_after=2024-04-03T02:54:00+00:00 2024-04-03T02:53:04.862909570Z [2024-04-03T02:53:04.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:53:04.863010877Z [2024-04-03T02:53:04.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:52:00+00:00, run_id=scheduled__2024-04-03T02:52:00+00:00, run_start_date=2024-04-03 02:53:00.494190+00:00, run_end_date=2024-04-03 02:53:04.862802+00:00, run_duration=4.368612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:52:00+00:00, data_interval_end=2024-04-03 02:53:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:53:04.872193350Z [2024-04-03T02:53:04.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:53:00+00:00, run_after=2024-04-03T02:54:00+00:00 2024-04-03T02:53:04.899336587Z [2024-04-03T02:53:04.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:52:00+00:00 exited with status success for try_number 1 2024-04-03T02:53:04.899358928Z [2024-04-03T02:53:04.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:52:00+00:00 exited with status success for try_number 1 2024-04-03T02:53:04.904840875Z [2024-04-03T02:53:04.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:52:00+00:00, map_index=-1, run_start_date=2024-04-03 02:53:02.636301+00:00, run_end_date=2024-04-03 02:53:04.020233+00:00, run_duration=1.383932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:53:00.541026+00:00, queued_by_job_id=1, pid=6684 2024-04-03T02:53:04.904968180Z [2024-04-03T02:53:04.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:52:00+00:00, map_index=-1, run_start_date=2024-04-03 02:53:02.745796+00:00, run_end_date=2024-04-03 02:53:04.402987+00:00, run_duration=1.657191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:53:00.541026+00:00, queued_by_job_id=1, pid=6685 2024-04-03T02:53:56.186270383Z [2024-04-03T02:53:56.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:53:00+00:00, run_after=2024-04-03T02:54:00+00:00 2024-04-03T02:53:56.227189677Z [2024-04-03T02:53:56.226+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:53:56.227225752Z 2024-04-03T02:53:56.227237444Z [2024-04-03T02:53:56.226+0000] {scheduler_job.py:425} INFO - DAG vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:53:56.227807578Z [2024-04-03T02:53:56.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:53:56.227815492Z 2024-04-03T02:53:56.230189919Z [2024-04-03T02:53:56.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:53:56.230240817Z [2024-04-03T02:53:56.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:53:56.271304997Z [2024-04-03T02:53:56.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:52:00+00:00 exited with status queued for try_number 1 2024-04-03T02:53:56.279260246Z [2024-04-03T02:53:56.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6864513-e63b-4e80-807a-cec77a1e7fa8 2024-04-03T02:53:59.655020525Z [2024-04-03T02:53:59.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:53:59.655532047Z [2024-04-03T02:53:59.655+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, execution_date=2024-04-03 02:52:00+00:00, run_id=scheduled__2024-04-03T02:52:00+00:00, run_start_date=2024-04-03 02:53:56.195251+00:00, run_end_date=2024-04-03 02:53:59.655074+00:00, run_duration=3.459823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:52:00+00:00, data_interval_end=2024-04-03 02:53:00+00:00, dag_hash=8895d7d7491d1e6a05788102de82bd30 2024-04-03T02:53:59.672766942Z [2024-04-03T02:53:59.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:53:00+00:00, run_after=2024-04-03T02:54:00+00:00 2024-04-03T02:53:59.704177973Z [2024-04-03T02:53:59.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:52:00+00:00 exited with status success for try_number 1 2024-04-03T02:53:59.711282066Z [2024-04-03T02:53:59.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:52:00+00:00, map_index=-1, run_start_date=2024-04-03 02:53:57.986463+00:00, run_end_date=2024-04-03 02:53:59.216298+00:00, run_duration=1.229835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:53:56.228081+00:00, queued_by_job_id=1, pid=6728 2024-04-03T02:54:00.788843948Z [2024-04-03T02:54:00.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:54:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:54:00.801436003Z [2024-04-03T02:54:00.799+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:54:00.814445023Z [2024-04-03T02:54:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:54:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:54:00.827218020Z [2024-04-03T02:54:00.826+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:54:00.841910703Z [2024-04-03T02:54:00.841+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:54:00.943705428Z [2024-04-03T02:54:00.943+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-03T02:54:00.943735036Z 2024-04-03T02:54:00.943741187Z 2024-04-03T02:54:00.943746267Z 2024-04-03T02:54:00.943751499Z 2024-04-03T02:54:00.943774894Z 2024-04-03T02:54:00.944165394Z [2024-04-03T02:54:00.943+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:54:00.944466880Z [2024-04-03T02:54:00.944+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:54:00.944742756Z [2024-04-03T02:54:00.944+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:54:00.945039067Z [2024-04-03T02:54:00.944+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:54:00.945289142Z [2024-04-03T02:54:00.945+0000] {scheduler_job.py:425} INFO - DAG vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:54:00.946244656Z [2024-04-03T02:54:00.945+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:54:00.946260247Z 2024-04-03T02:54:00.946265884Z 2024-04-03T02:54:00.946282184Z 2024-04-03T02:54:00.946292784Z 2024-04-03T02:54:00.946297720Z 2024-04-03T02:54:00.952124815Z [2024-04-03T02:54:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:54:00.952392896Z [2024-04-03T02:54:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:54:00.952855648Z [2024-04-03T02:54:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:54:00.953089233Z [2024-04-03T02:54:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:54:00.953452658Z [2024-04-03T02:54:00.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:54:00.953867111Z [2024-04-03T02:54:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:54:00.954216146Z [2024-04-03T02:54:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:54:00.954437500Z [2024-04-03T02:54:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:54:00.954808424Z [2024-04-03T02:54:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:54:00.955028309Z [2024-04-03T02:54:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:54:01.695666958Z [2024-04-03T02:54:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:52:00+00:00 exited with status queued for try_number 1 2024-04-03T02:54:01.697742807Z [2024-04-03T02:54:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:53:00+00:00 exited with status queued for try_number 1 2024-04-03T02:54:01.700142777Z [2024-04-03T02:54:01.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:53:00+00:00 exited with status queued for try_number 1 2024-04-03T02:54:01.700379322Z [2024-04-03T02:54:01.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:53:00+00:00 exited with status queued for try_number 1 2024-04-03T02:54:01.700573983Z [2024-04-03T02:54:01.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:53:00+00:00 exited with status queued for try_number 1 2024-04-03T02:54:01.728468684Z [2024-04-03T02:54:01.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddfc00f3-bbb2-4ad5-a4d0-9fc091c90b79 2024-04-03T02:54:01.728791660Z [2024-04-03T02:54:01.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12bab2bb-3de5-460b-b81a-502c385900a8 2024-04-03T02:54:01.729486795Z [2024-04-03T02:54:01.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83a657db-1b47-4bfc-b1ba-fd6fc3fd1311 2024-04-03T02:54:01.731321302Z [2024-04-03T02:54:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to d20080de-992c-445d-8cf4-426be26e0765 2024-04-03T02:54:01.732307574Z [2024-04-03T02:54:01.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to a98d9304-e02c-4989-a273-db52559008a0 2024-04-03T02:54:05.634334937Z [2024-04-03T02:54:05.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:54:05.635304768Z [2024-04-03T02:54:05.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:52:00+00:00, run_id=scheduled__2024-04-03T02:52:00+00:00, run_start_date=2024-04-03 02:54:00.855554+00:00, run_end_date=2024-04-03 02:54:05.634256+00:00, run_duration=4.778702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:52:00+00:00, data_interval_end=2024-04-03 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:54:05.661001645Z [2024-04-03T02:54:05.660+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:54:00+00:00, run_after=2024-04-03T02:56:00+00:00 2024-04-03T02:54:05.822201033Z [2024-04-03T02:54:05.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:52:00+00:00 exited with status success for try_number 1 2024-04-03T02:54:05.832453486Z [2024-04-03T02:54:05.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:52:00+00:00, map_index=-1, run_start_date=2024-04-03 02:54:03.016909+00:00, run_end_date=2024-04-03 02:54:04.626560+00:00, run_duration=1.609651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:54:00.947866+00:00, queued_by_job_id=1, pid=6745 2024-04-03T02:54:06.876631172Z [2024-04-03T02:54:06.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:50:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:54:06.922404817Z [2024-04-03T02:54:06.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:54:06.922955001Z [2024-04-03T02:54:06.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:53:00+00:00, run_id=scheduled__2024-04-03T02:53:00+00:00, run_start_date=2024-04-03 02:54:00.857173+00:00, run_end_date=2024-04-03 02:54:06.922204+00:00, run_duration=6.065031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:53:00+00:00, data_interval_end=2024-04-03 02:54:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:54:06.936988818Z [2024-04-03T02:54:06.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:54:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:54:06.982333595Z [2024-04-03T02:54:06.981+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:54:06.982364389Z 2024-04-03T02:54:06.982726639Z [2024-04-03T02:54:06.982+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:54:06.983411751Z [2024-04-03T02:54:06.983+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:54:06.983424068Z 2024-04-03T02:54:06.986173617Z [2024-04-03T02:54:06.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:54:06.986468041Z [2024-04-03T02:54:06.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:54:07.057358477Z [2024-04-03T02:54:07.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:54:07.059493976Z [2024-04-03T02:54:07.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:53:00+00:00 exited with status success for try_number 1 2024-04-03T02:54:07.067784370Z [2024-04-03T02:54:07.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:53:00+00:00, map_index=-1, run_start_date=2024-04-03 02:54:03.984377+00:00, run_end_date=2024-04-03 02:54:06.754678+00:00, run_duration=2.770301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:54:00.947866+00:00, queued_by_job_id=1, pid=6757 2024-04-03T02:54:07.068152926Z [2024-04-03T02:54:07.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0ca182a-6e1b-4fa7-aed1-6ca23fc5881c 2024-04-03T02:54:07.109276693Z [2024-04-03T02:54:07.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:54:07.109663182Z [2024-04-03T02:54:07.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, execution_date=2024-04-03 02:53:00+00:00, run_id=scheduled__2024-04-03T02:53:00+00:00, run_start_date=2024-04-03 02:54:00.856125+00:00, run_end_date=2024-04-03 02:54:07.109182+00:00, run_duration=6.253057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:53:00+00:00, data_interval_end=2024-04-03 02:54:00+00:00, dag_hash=8895d7d7491d1e6a05788102de82bd30 2024-04-03T02:54:07.117830055Z [2024-04-03T02:54:07.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:54:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:54:07.177629438Z [2024-04-03T02:54:07.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:53:00+00:00 exited with status success for try_number 1 2024-04-03T02:54:07.184291839Z [2024-04-03T02:54:07.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:53:00+00:00, map_index=-1, run_start_date=2024-04-03 02:54:04.987472+00:00, run_end_date=2024-04-03 02:54:06.962354+00:00, run_duration=1.974882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:54:00.947866+00:00, queued_by_job_id=1, pid=6804 2024-04-03T02:54:07.568265601Z [2024-04-03T02:54:07.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:54:07.568397614Z [2024-04-03T02:54:07.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, execution_date=2024-04-03 02:53:00+00:00, run_id=scheduled__2024-04-03T02:53:00+00:00, run_start_date=2024-04-03 02:54:00.857433+00:00, run_end_date=2024-04-03 02:54:07.568168+00:00, run_duration=6.710735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:53:00+00:00, data_interval_end=2024-04-03 02:54:00+00:00, dag_hash=f413de3d0b59a6520e3f0447f59abca3 2024-04-03T02:54:07.577647414Z [2024-04-03T02:54:07.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:54:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:54:07.586437635Z [2024-04-03T02:54:07.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:54:07.587066285Z [2024-04-03T02:54:07.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:53:00+00:00, run_id=scheduled__2024-04-03T02:53:00+00:00, run_start_date=2024-04-03 02:54:00.858377+00:00, run_end_date=2024-04-03 02:54:07.586554+00:00, run_duration=6.728177, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:53:00+00:00, data_interval_end=2024-04-03 02:54:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:54:07.607300538Z [2024-04-03T02:54:07.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:54:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:54:07.684875396Z [2024-04-03T02:54:07.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:53:00+00:00 exited with status success for try_number 1 2024-04-03T02:54:07.692161019Z [2024-04-03T02:54:07.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:53:00+00:00, map_index=-1, run_start_date=2024-04-03 02:54:04.857193+00:00, run_end_date=2024-04-03 02:54:07.437712+00:00, run_duration=2.580519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:54:00.947866+00:00, queued_by_job_id=1, pid=6801 2024-04-03T02:54:08.834210681Z [2024-04-03T02:54:08.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:53:00+00:00 exited with status success for try_number 1 2024-04-03T02:54:08.839473829Z [2024-04-03T02:54:08.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:53:00+00:00, map_index=-1, run_start_date=2024-04-03 02:54:05.341817+00:00, run_end_date=2024-04-03 02:54:07.540959+00:00, run_duration=2.199142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:54:00.947866+00:00, queued_by_job_id=1, pid=6805 2024-04-03T02:54:09.917301277Z [2024-04-03T02:54:09.916+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:54:09.917326292Z 2024-04-03T02:54:09.917485388Z [2024-04-03T02:54:09.917+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:54:09.918099103Z [2024-04-03T02:54:09.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:54:09.918110422Z 2024-04-03T02:54:09.920893063Z [2024-04-03T02:54:09.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='split_metrics', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:54:09.920908496Z [2024-04-03T02:54:09.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'split_metrics', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:54:09.963908109Z [2024-04-03T02:54:09.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.split_metrics run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:54:09.964076242Z [2024-04-03T02:54:09.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:54:09.970410981Z [2024-04-03T02:54:09.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=-1, run_start_date=2024-04-03 02:54:08.690528+00:00, run_end_date=2024-04-03 02:54:09.088862+00:00, run_duration=0.398334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:54:06.983960+00:00, queued_by_job_id=1, pid=6844 2024-04-03T02:54:09.970805348Z [2024-04-03T02:54:09.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab200ec5-eb5e-4b1f-af66-ae8ac2ad6392 2024-04-03T02:54:12.304358645Z [2024-04-03T02:54:12.303+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:54:12.304385601Z 2024-04-03T02:54:12.304721256Z [2024-04-03T02:54:12.304+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:54:12.306560314Z [2024-04-03T02:54:12.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:54:12.306575602Z 2024-04-03T02:54:12.312742929Z [2024-04-03T02:54:12.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:54:12.312930141Z [2024-04-03T02:54:12.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'collect_metrics', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:54:12.436216571Z [2024-04-03T02:54:12.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.collect_metrics run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:54:12.436887230Z [2024-04-03T02:54:12.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.split_metrics run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:54:12.446719401Z [2024-04-03T02:54:12.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3668467-9838-4638-b435-ec9c02b916dc 2024-04-03T02:54:12.447266999Z [2024-04-03T02:54:12.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=split_metrics, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=-1, run_start_date=2024-04-03 02:54:11.767326+00:00, run_end_date=2024-04-03 02:54:12.082804+00:00, run_duration=0.315478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:54:09.918474+00:00, queued_by_job_id=1, pid=6865 2024-04-03T02:54:14.840923088Z [2024-04-03T02:54:14.840+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:54:14.840950111Z 2024-04-03T02:54:14.841200878Z [2024-04-03T02:54:14.840+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:54:14.841909221Z [2024-04-03T02:54:14.841+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:54:14.841920815Z 2024-04-03T02:54:14.844103719Z [2024-04-03T02:54:14.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:54:14.844218606Z [2024-04-03T02:54:14.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'send_prometheus', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:54:14.895155407Z [2024-04-03T02:54:14.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.send_prometheus run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status queued for try_number 1 2024-04-03T02:54:14.895397887Z [2024-04-03T02:54:14.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.collect_metrics run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:54:14.904642972Z [2024-04-03T02:54:14.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=0, run_start_date=2024-04-03 02:54:14.164941+00:00, run_end_date=2024-04-03 02:54:14.510716+00:00, run_duration=0.345775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:54:12.307741+00:00, queued_by_job_id=1, pid=6877 2024-04-03T02:54:14.905445798Z [2024-04-03T02:54:14.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2344ae22-52d4-4843-ba5b-e3e7a1a8e066 2024-04-03T02:54:17.103153735Z [2024-04-03T02:54:17.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:54:17.103697540Z [2024-04-03T02:54:17.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, execution_date=2024-04-03 02:45:00+00:00, run_id=scheduled__2024-04-03T02:45:00+00:00, run_start_date=2024-04-03 02:54:06.891636+00:00, run_end_date=2024-04-03 02:54:17.103369+00:00, run_duration=10.211733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:45:00+00:00, data_interval_end=2024-04-03 02:50:00+00:00, dag_hash=d518bb177f017a4565972b5e84804738 2024-04-03T02:54:17.109267594Z [2024-04-03T02:54:17.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:50:00+00:00, run_after=2024-04-03T02:55:00+00:00 2024-04-03T02:54:17.145041309Z [2024-04-03T02:54:17.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.send_prometheus run_id=scheduled__2024-04-03T02:45:00+00:00 exited with status success for try_number 1 2024-04-03T02:54:17.152702082Z [2024-04-03T02:54:17.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:45:00+00:00, map_index=-1, run_start_date=2024-04-03 02:54:16.368681+00:00, run_end_date=2024-04-03 02:54:16.730928+00:00, run_duration=0.362247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:54:14.842308+00:00, queued_by_job_id=1, pid=6888 2024-04-03T02:55:01.059304787Z [2024-04-03T02:55:01.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:55:00+00:00, run_after=2024-04-03T03:00:00+00:00 2024-04-03T02:55:01.070508080Z [2024-04-03T02:55:01.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:55:01.077491943Z [2024-04-03T02:55:01.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:55:01.094699152Z [2024-04-03T02:55:01.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:55:00+00:00, run_after=2024-04-03T02:56:00+00:00 2024-04-03T02:55:01.110363309Z [2024-04-03T02:55:01.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:55:00+00:00, run_after=2024-04-03T02:56:00+00:00 2024-04-03T02:55:01.123135842Z [2024-04-03T02:55:01.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:55:00+00:00, run_after=2024-04-03T03:00:00+00:00 2024-04-03T02:55:01.263760353Z [2024-04-03T02:55:01.262+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-03T02:55:01.263795670Z 2024-04-03T02:55:01.263799303Z 2024-04-03T02:55:01.263802878Z 2024-04-03T02:55:01.263823601Z 2024-04-03T02:55:01.263827195Z 2024-04-03T02:55:01.263847038Z 2024-04-03T02:55:01.263850737Z [2024-04-03T02:55:01.262+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:55:01.263854367Z [2024-04-03T02:55:01.262+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:55:01.263857848Z [2024-04-03T02:55:01.262+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:55:01.263860936Z [2024-04-03T02:55:01.263+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:55:01.263863918Z [2024-04-03T02:55:01.263+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:55:01.263867009Z [2024-04-03T02:55:01.263+0000] {scheduler_job.py:425} INFO - DAG vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:55:01.265746297Z [2024-04-03T02:55:01.265+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:55:01.265761735Z 2024-04-03T02:55:01.265765588Z 2024-04-03T02:55:01.265768960Z 2024-04-03T02:55:01.265772122Z 2024-04-03T02:55:01.265786241Z 2024-04-03T02:55:01.265789372Z 2024-04-03T02:55:01.280849357Z [2024-04-03T02:55:01.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:55:01.280869491Z [2024-04-03T02:55:01.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:01.280873633Z [2024-04-03T02:55:01.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:55:01.280876917Z [2024-04-03T02:55:01.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:01.280879967Z [2024-04-03T02:55:01.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:55:01.280883034Z [2024-04-03T02:55:01.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:55:01.280886176Z [2024-04-03T02:55:01.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:55:01.280954340Z [2024-04-03T02:55:01.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:55:01.281144557Z [2024-04-03T02:55:01.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:55:01.281573085Z [2024-04-03T02:55:01.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:55:01.281886335Z [2024-04-03T02:55:01.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:55:01.281999335Z [2024-04-03T02:55:01.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:55:01.850230645Z [2024-04-03T02:55:01.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status queued for try_number 1 2024-04-03T02:55:01.850485894Z [2024-04-03T02:55:01.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status queued for try_number 1 2024-04-03T02:55:01.850673174Z [2024-04-03T02:55:01.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status queued for try_number 1 2024-04-03T02:55:01.850773234Z [2024-04-03T02:55:01.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status queued for try_number 1 2024-04-03T02:55:01.850891327Z [2024-04-03T02:55:01.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status queued for try_number 1 2024-04-03T02:55:01.850978053Z [2024-04-03T02:55:01.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status queued for try_number 1 2024-04-03T02:55:01.875458294Z [2024-04-03T02:55:01.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fcfeddf-e666-47bd-902d-500f7b389d7a 2024-04-03T02:55:01.875703132Z [2024-04-03T02:55:01.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31d77355-c53b-44cd-af3c-a6172bb01528 2024-04-03T02:55:01.875917466Z [2024-04-03T02:55:01.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to 463b0265-583c-46bd-99be-f2d24254a05e 2024-04-03T02:55:01.876297184Z [2024-04-03T02:55:01.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef10dd88-e1c8-4eea-988a-1410b23043a4 2024-04-03T02:55:01.877491045Z [2024-04-03T02:55:01.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c9c8b52-9926-4fe4-878d-83565fb8baa7 2024-04-03T02:55:01.877660941Z [2024-04-03T02:55:01.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4acd24d-b7af-467f-9db6-5c9371c8e541 2024-04-03T02:55:03.922289181Z [2024-04-03T02:55:03.921+0000] {dagbag.py:207} WARNING - Serialized DAG vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 no longer exists 2024-04-03T02:55:03.922328128Z [2024-04-03T02:55:03.921+0000] {scheduler_job.py:1276} ERROR - Couldn't find dag vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 in DagBag/DB! 2024-04-03T02:55:03.956772519Z [2024-04-03T02:55:03.956+0000] {scheduler_job.py:970} ERROR - DAG 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' not found in serialized_dag table 2024-04-03T02:55:06.425247644Z [2024-04-03T02:55:06.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status failed for try_number 1 2024-04-03T02:55:06.425420922Z [2024-04-03T02:55:06.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status failed for try_number 1 2024-04-03T02:55:06.425601205Z [2024-04-03T02:55:06.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status failed for try_number 1 2024-04-03T02:55:06.432738741Z [2024-04-03T02:55:06.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:50:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:01.267468+00:00, queued_by_job_id=1, pid=None 2024-04-03T02:55:06.433265266Z [2024-04-03T02:55:06.433+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:55:06.435269153Z [2024-04-03T02:55:06.435+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:55:06.447372626Z [2024-04-03T02:55:06.447+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=extract_metrics_from_vnfrs, execution_date=20240403T025000, start_date=, end_date=20240403T025506 2024-04-03T02:55:06.456414345Z [2024-04-03T02:55:06.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:01.267468+00:00, queued_by_job_id=1, pid=None 2024-04-03T02:55:06.456906492Z [2024-04-03T02:55:06.456+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:55:06.458986480Z [2024-04-03T02:55:06.458+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:55:06.473256751Z [2024-04-03T02:55:06.472+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240403T025400, start_date=, end_date=20240403T025506 2024-04-03T02:55:06.481417807Z [2024-04-03T02:55:06.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:01.267468+00:00, queued_by_job_id=1, pid=None 2024-04-03T02:55:06.481898019Z [2024-04-03T02:55:06.481+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:55:06.488368190Z [2024-04-03T02:55:06.485+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-03T02:55:06.488384325Z Traceback (most recent call last): 2024-04-03T02:55:06.488388527Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-03T02:55:06.488391620Z task = dag.get_task(ti.task_id) 2024-04-03T02:55:06.488395278Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-03T02:55:07.546211695Z [2024-04-03T02:55:07.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:55:07.547239566Z [2024-04-03T02:55:07.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:54:00+00:00, run_id=scheduled__2024-04-03T02:54:00+00:00, run_start_date=2024-04-03 02:55:01.161916+00:00, run_end_date=2024-04-03 02:55:07.546747+00:00, run_duration=6.384831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:54:00+00:00, data_interval_end=2024-04-03 02:55:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:55:07.563447071Z [2024-04-03T02:55:07.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:55:00+00:00, run_after=2024-04-03T02:56:00+00:00 2024-04-03T02:55:07.627296192Z [2024-04-03T02:55:07.626+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:55:07.627323566Z 2024-04-03T02:55:07.627459299Z [2024-04-03T02:55:07.627+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:55:07.628390731Z [2024-04-03T02:55:07.627+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:55:07.628437997Z 2024-04-03T02:55:07.631408861Z [2024-04-03T02:55:07.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T02:55:07.631980038Z [2024-04-03T02:55:07.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:07.682630936Z [2024-04-03T02:55:07.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status queued for try_number 1 2024-04-03T02:55:07.683718932Z [2024-04-03T02:55:07.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status success for try_number 1 2024-04-03T02:55:07.683841571Z [2024-04-03T02:55:07.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status success for try_number 1 2024-04-03T02:55:07.691258973Z [2024-04-03T02:55:07.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:50:00+00:00, map_index=-1, run_start_date=2024-04-03 02:55:06.000344+00:00, run_end_date=2024-04-03 02:55:06.346137+00:00, run_duration=0.345793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:01.267468+00:00, queued_by_job_id=1, pid=7006 2024-04-03T02:55:07.691383561Z [2024-04-03T02:55:07.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:54:00+00:00, map_index=-1, run_start_date=2024-04-03 02:55:05.550101+00:00, run_end_date=2024-04-03 02:55:07.362083+00:00, run_duration=1.811982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:01.267468+00:00, queued_by_job_id=1, pid=6968 2024-04-03T02:55:07.691537542Z [2024-04-03T02:55:07.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff79413b-1954-41ea-9f6e-07cfe6f92f61 2024-04-03T02:55:09.881786656Z [2024-04-03T02:55:09.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:55:09.882205718Z [2024-04-03T02:55:09.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:54:00+00:00, run_id=scheduled__2024-04-03T02:54:00+00:00, run_start_date=2024-04-03 02:55:01.159738+00:00, run_end_date=2024-04-03 02:55:09.881671+00:00, run_duration=8.721933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:54:00+00:00, data_interval_end=2024-04-03 02:55:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:55:09.893550365Z [2024-04-03T02:55:09.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:55:00+00:00, run_after=2024-04-03T02:56:00+00:00 2024-04-03T02:55:09.953634660Z [2024-04-03T02:55:09.953+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:55:09.953658081Z 2024-04-03T02:55:09.954005727Z [2024-04-03T02:55:09.953+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:55:09.954844230Z [2024-04-03T02:55:09.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:55:09.954858589Z 2024-04-03T02:55:09.957753853Z [2024-04-03T02:55:09.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T02:55:09.958086756Z [2024-04-03T02:55:09.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:55:10.051089801Z [2024-04-03T02:55:10.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status queued for try_number 1 2024-04-03T02:55:10.051113010Z [2024-04-03T02:55:10.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status success for try_number 1 2024-04-03T02:55:10.051116675Z [2024-04-03T02:55:10.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status success for try_number 1 2024-04-03T02:55:10.123590220Z [2024-04-03T02:55:10.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ab9fc7c-8795-4740-8766-aeac2b240b51 2024-04-03T02:55:10.126735127Z [2024-04-03T02:55:10.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:54:00+00:00, map_index=-1, run_start_date=2024-04-03 02:55:05.717101+00:00, run_end_date=2024-04-03 02:55:08.903260+00:00, run_duration=3.186159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:01.267468+00:00, queued_by_job_id=1, pid=6978 2024-04-03T02:55:10.126754191Z [2024-04-03T02:55:10.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:50:00+00:00, map_index=-1, run_start_date=2024-04-03 02:55:09.484213+00:00, run_end_date=2024-04-03 02:55:09.767836+00:00, run_duration=0.283623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:07.628787+00:00, queued_by_job_id=1, pid=7036 2024-04-03T02:55:12.448593180Z [2024-04-03T02:55:12.448+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:55:12.448617114Z 2024-04-03T02:55:12.448802071Z [2024-04-03T02:55:12.448+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:55:12.449646633Z [2024-04-03T02:55:12.449+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:55:12.449658839Z 2024-04-03T02:55:12.451937991Z [2024-04-03T02:55:12.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:55:12.452129247Z [2024-04-03T02:55:12.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:12.530943735Z [2024-04-03T02:55:12.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status queued for try_number 1 2024-04-03T02:55:12.530975210Z [2024-04-03T02:55:12.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status success for try_number 1 2024-04-03T02:55:12.539473656Z [2024-04-03T02:55:12.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 654af9f6-f250-4c93-907d-7c947f4d1d29 2024-04-03T02:55:12.539563713Z [2024-04-03T02:55:12.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:50:00+00:00, map_index=0, run_start_date=2024-04-03 02:55:11.785722+00:00, run_end_date=2024-04-03 02:55:12.135690+00:00, run_duration=0.349968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:09.955482+00:00, queued_by_job_id=1, pid=7048 2024-04-03T02:55:15.229400883Z [2024-04-03T02:55:15.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:55:15.229616715Z [2024-04-03T02:55:15.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:50:00+00:00, run_id=scheduled__2024-04-03T02:50:00+00:00, run_start_date=2024-04-03 02:55:01.155064+00:00, run_end_date=2024-04-03 02:55:15.229272+00:00, run_duration=14.074208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:50:00+00:00, data_interval_end=2024-04-03 02:55:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T02:55:15.236472564Z [2024-04-03T02:55:15.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:55:00+00:00, run_after=2024-04-03T03:00:00+00:00 2024-04-03T02:55:15.307051994Z [2024-04-03T02:55:15.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status success for try_number 1 2024-04-03T02:55:15.313465579Z [2024-04-03T02:55:15.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:50:00+00:00, map_index=-1, run_start_date=2024-04-03 02:55:14.403047+00:00, run_end_date=2024-04-03 02:55:14.746913+00:00, run_duration=0.343866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:12.450069+00:00, queued_by_job_id=1, pid=7060 2024-04-03T02:55:17.440225119Z [2024-04-03T02:55:17.439+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:55:17.440253209Z 2024-04-03T02:55:17.440257506Z 2024-04-03T02:55:17.440462198Z [2024-04-03T02:55:17.440+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:55:17.440721427Z [2024-04-03T02:55:17.440+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:55:17.441456257Z [2024-04-03T02:55:17.441+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:55:17.441468048Z 2024-04-03T02:55:17.441471973Z 2024-04-03T02:55:17.444057650Z [2024-04-03T02:55:17.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:50:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-03T02:55:17.444242427Z [2024-04-03T02:55:17.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:17.444521417Z [2024-04-03T02:55:17.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:54:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:55:17.444692720Z [2024-04-03T02:55:17.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:55:17.604620428Z [2024-04-03T02:55:17.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status queued for try_number 2 2024-04-03T02:55:17.604656142Z [2024-04-03T02:55:17.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status queued for try_number 2 2024-04-03T02:55:17.613164454Z [2024-04-03T02:55:17.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8185f534-5ce3-44b2-8c22-d4e7c2a6a0f3 2024-04-03T02:55:17.613187600Z [2024-04-03T02:55:17.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 322bfce2-05cc-4257-b2f4-cc112fa8f248 2024-04-03T02:55:20.062388760Z [2024-04-03T02:55:20.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:50:00+00:00 exited with status failed for try_number 2 2024-04-03T02:55:20.065303874Z [2024-04-03T02:55:20.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status failed for try_number 2 2024-04-03T02:55:20.070689679Z [2024-04-03T02:55:20.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-03 02:55:06.462087+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:17.442013+00:00, queued_by_job_id=1, pid=None 2024-04-03T02:55:20.070709708Z [2024-04-03T02:55:20.069+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:55:20.076334095Z [2024-04-03T02:55:20.075+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:55:20.093322531Z [2024-04-03T02:55:20.092+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240403T025400, start_date=, end_date=20240403T025520 2024-04-03T02:55:20.106155717Z [2024-04-03T02:55:20.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:50:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-03 02:55:06.437522+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:55:17.442013+00:00, queued_by_job_id=1, pid=None 2024-04-03T02:55:20.106712537Z [2024-04-03T02:55:20.106+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:55:20.109539557Z [2024-04-03T02:55:20.109+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:55:20.127698856Z [2024-04-03T02:55:20.127+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=extract_metrics_from_vnfrs, execution_date=20240403T025000, start_date=, end_date=20240403T025520 2024-04-03T02:55:21.186787000Z [2024-04-03T02:55:21.186+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T02:55:21.187127065Z [2024-04-03T02:55:21.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, execution_date=2024-04-03 02:54:00+00:00, run_id=scheduled__2024-04-03T02:54:00+00:00, run_start_date=2024-04-03 02:55:01.157519+00:00, run_end_date=2024-04-03 02:55:21.186718+00:00, run_duration=20.029199, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:54:00+00:00, data_interval_end=2024-04-03 02:55:00+00:00, dag_hash=f413de3d0b59a6520e3f0447f59abca3 2024-04-03T02:55:21.199559790Z [2024-04-03T02:55:21.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:55:00+00:00, run_after=2024-04-03T02:56:00+00:00 2024-04-03T02:55:24.014356801Z [2024-04-03T02:55:24.013+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-03T02:55:24.014565005Z [2024-04-03T02:55:24.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, execution_date=2024-04-03 02:50:00+00:00, run_id=scheduled__2024-04-03T02:50:00+00:00, run_start_date=2024-04-03 02:55:01.156492+00:00, run_end_date=2024-04-03 02:55:24.014257+00:00, run_duration=22.857765, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:50:00+00:00, data_interval_end=2024-04-03 02:55:00+00:00, dag_hash=d518bb177f017a4565972b5e84804738 2024-04-03T02:55:24.021098326Z [2024-04-03T02:55:24.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 to 2024-04-03T02:55:00+00:00, run_after=2024-04-03T03:00:00+00:00 2024-04-03T02:56:00.497070219Z [2024-04-03T02:56:00.496+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:56:00.503876079Z [2024-04-03T02:56:00.503+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:56:00.517922981Z [2024-04-03T02:56:00.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:56:00+00:00, run_after=2024-04-03T02:57:00+00:00 2024-04-03T02:56:00.527607411Z [2024-04-03T02:56:00.527+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:56:00.625237469Z [2024-04-03T02:56:00.624+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T02:56:00.625261031Z 2024-04-03T02:56:00.625265875Z 2024-04-03T02:56:00.625271073Z 2024-04-03T02:56:00.625275673Z 2024-04-03T02:56:00.625431004Z [2024-04-03T02:56:00.625+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:56:00.625501596Z [2024-04-03T02:56:00.625+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:56:00.625508403Z [2024-04-03T02:56:00.625+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 has 0/16 running and queued tasks 2024-04-03T02:56:00.625803430Z [2024-04-03T02:56:00.625+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:56:00.626663419Z [2024-04-03T02:56:00.626+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:56:00.626684793Z 2024-04-03T02:56:00.626690568Z 2024-04-03T02:56:00.626695436Z 2024-04-03T02:56:00.626700241Z 2024-04-03T02:56:00.631553596Z [2024-04-03T02:56:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:56:00.631591993Z [2024-04-03T02:56:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:56:00.631787656Z [2024-04-03T02:56:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:56:00.631872353Z [2024-04-03T02:56:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:56:00.632039650Z [2024-04-03T02:56:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:56:00.632129961Z [2024-04-03T02:56:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:56:00.632313699Z [2024-04-03T02:56:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:56:00.632362465Z [2024-04-03T02:56:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:56:01.213135630Z [2024-04-03T02:56:01.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status queued for try_number 1 2024-04-03T02:56:01.213380889Z [2024-04-03T02:56:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status queued for try_number 1 2024-04-03T02:56:01.213539550Z [2024-04-03T02:56:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status queued for try_number 1 2024-04-03T02:56:01.213687553Z [2024-04-03T02:56:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status queued for try_number 1 2024-04-03T02:56:01.232353804Z [2024-04-03T02:56:01.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd414dfa-ce0f-4d14-9f41-0c6138649224 2024-04-03T02:56:01.232384504Z [2024-04-03T02:56:01.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 310da83a-a8a5-4dcb-8542-6b0ada859d32 2024-04-03T02:56:01.232533715Z [2024-04-03T02:56:01.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f6d0dbb-23a6-41ef-be18-61731781808c 2024-04-03T02:56:01.232623516Z [2024-04-03T02:56:01.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 600acde8-7b62-4855-a8f8-f3db1ac2e07a 2024-04-03T02:56:02.471700422Z [2024-04-03T02:56:02.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:56:02.472301918Z [2024-04-03T02:56:02.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:54:00+00:00, run_id=scheduled__2024-04-03T02:54:00+00:00, run_start_date=2024-04-03 02:56:00.542886+00:00, run_end_date=2024-04-03 02:56:02.471946+00:00, run_duration=1.92906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:54:00+00:00, data_interval_end=2024-04-03 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:56:02.479893154Z [2024-04-03T02:56:02.479+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:56:00+00:00, run_after=2024-04-03T02:58:00+00:00 2024-04-03T02:56:02.553202851Z [2024-04-03T02:56:02.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:54:00+00:00 exited with status success for try_number 1 2024-04-03T02:56:02.558543826Z [2024-04-03T02:56:02.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:54:00+00:00, map_index=-1, run_start_date=2024-04-03 02:56:01.696993+00:00, run_end_date=2024-04-03 02:56:02.373963+00:00, run_duration=0.67697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:56:00.627607+00:00, queued_by_job_id=1, pid=7118 2024-04-03T02:56:04.546809013Z [2024-04-03T02:56:04.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status failed for try_number 1 2024-04-03T02:56:04.564305694Z [2024-04-03T02:56:04.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:55:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:56:00.627607+00:00, queued_by_job_id=1, pid=None 2024-04-03T02:56:04.564757589Z [2024-04-03T02:56:04.564+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-03T02:56:04.568234142Z [2024-04-03T02:56:04.567+0000] {dagbag.py:207} WARNING - Serialized DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 no longer exists 2024-04-03T02:56:04.572195087Z [2024-04-03T02:56:04.570+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-03T02:56:04.572211345Z Traceback (most recent call last): 2024-04-03T02:56:04.572215257Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-03T02:56:04.572218535Z task = dag.get_task(ti.task_id) 2024-04-03T02:56:04.572221946Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-03T02:56:06.778279714Z [2024-04-03T02:56:06.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:56:06.780869019Z [2024-04-03T02:56:06.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:55:00+00:00, run_id=scheduled__2024-04-03T02:55:00+00:00, run_start_date=2024-04-03 02:56:00.548175+00:00, run_end_date=2024-04-03 02:56:06.778907+00:00, run_duration=6.230732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:55:00+00:00, data_interval_end=2024-04-03 02:56:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:56:06.793249797Z [2024-04-03T02:56:06.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:56:00+00:00, run_after=2024-04-03T02:57:00+00:00 2024-04-03T02:56:06.800849769Z [2024-04-03T02:56:06.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:56:06.800975606Z [2024-04-03T02:56:06.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:55:00+00:00, run_id=scheduled__2024-04-03T02:55:00+00:00, run_start_date=2024-04-03 02:56:00.545450+00:00, run_end_date=2024-04-03 02:56:06.800681+00:00, run_duration=6.255231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:55:00+00:00, data_interval_end=2024-04-03 02:56:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:56:06.810948908Z [2024-04-03T02:56:06.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:56:00+00:00, run_after=2024-04-03T02:57:00+00:00 2024-04-03T02:56:06.849179086Z [2024-04-03T02:56:06.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status success for try_number 1 2024-04-03T02:56:06.849225023Z [2024-04-03T02:56:06.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status success for try_number 1 2024-04-03T02:56:06.858628768Z [2024-04-03T02:56:06.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:55:00+00:00, map_index=-1, run_start_date=2024-04-03 02:56:04.552104+00:00, run_end_date=2024-04-03 02:56:06.528329+00:00, run_duration=1.976225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:56:00.627607+00:00, queued_by_job_id=1, pid=7176 2024-04-03T02:56:06.858761964Z [2024-04-03T02:56:06.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:55:00+00:00, map_index=-1, run_start_date=2024-04-03 02:56:04.359182+00:00, run_end_date=2024-04-03 02:56:05.766820+00:00, run_duration=1.407638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:56:00.627607+00:00, queued_by_job_id=1, pid=7167 2024-04-03T02:56:24.081856477Z [2024-04-03T02:56:24.081+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T02:56:24.081911376Z 2024-04-03T02:56:24.082193451Z [2024-04-03T02:56:24.081+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-03T02:56:24.083138248Z [2024-04-03T02:56:24.082+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:56:24.083178950Z 2024-04-03T02:56:24.086347106Z [2024-04-03T02:56:24.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240403025623_652359', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:56:24.086558544Z [2024-04-03T02:56:24.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240403025623_652359', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-03T02:56:24.138958147Z [2024-04-03T02:56:24.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240403025623_652359 exited with status queued for try_number 1 2024-04-03T02:56:24.146318529Z [2024-04-03T02:56:24.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31bf3b19-3007-495d-a7a8-6ab3495b283a 2024-04-03T02:56:26.003993845Z [2024-04-03T02:56:26.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:56:26.004427558Z [2024-04-03T02:56:26.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-03 02:56:23.838749+00:00, run_id=vdu_down_20240403025623_652359, run_start_date=2024-04-03 02:56:24.036051+00:00, run_end_date=2024-04-03 02:56:26.003905+00:00, run_duration=1.967854, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-03 02:56:23.838749+00:00, data_interval_end=2024-04-03 02:56:23.838749+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-03T02:56:26.007616776Z [2024-04-03T02:56:26.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-03T02:56:26.043486356Z [2024-04-03T02:56:26.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240403025623_652359 exited with status success for try_number 1 2024-04-03T02:56:26.051831932Z [2024-04-03T02:56:26.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240403025623_652359, map_index=-1, run_start_date=2024-04-03 02:56:24.851813+00:00, run_end_date=2024-04-03 02:56:25.313247+00:00, run_duration=0.461434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:56:24.083574+00:00, queued_by_job_id=1, pid=7201 2024-04-03T02:56:35.754854773Z [2024-04-03T02:56:35.754+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T02:57:00.409325304Z [2024-04-03T02:57:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:57:00+00:00, run_after=2024-04-03T02:58:00+00:00 2024-04-03T02:57:00.421733558Z [2024-04-03T02:57:00.421+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:57:00.488261267Z [2024-04-03T02:57:00.487+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:57:00.488287635Z 2024-04-03T02:57:00.488291398Z 2024-04-03T02:57:00.488333161Z [2024-04-03T02:57:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:57:00.488361093Z [2024-04-03T02:57:00.488+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:57:00.488808196Z [2024-04-03T02:57:00.488+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:57:00.488825962Z 2024-04-03T02:57:00.488829746Z 2024-04-03T02:57:00.491221719Z [2024-04-03T02:57:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:57:00.491347958Z [2024-04-03T02:57:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:57:00.491500157Z [2024-04-03T02:57:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:57:00.491576713Z [2024-04-03T02:57:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:57:00.832401582Z [2024-04-03T02:57:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:56:00+00:00 exited with status queued for try_number 1 2024-04-03T02:57:00.832465739Z [2024-04-03T02:57:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:56:00+00:00 exited with status queued for try_number 1 2024-04-03T02:57:00.847530020Z [2024-04-03T02:57:00.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42d131de-870e-495e-a6af-eb9a82904427 2024-04-03T02:57:00.849927116Z [2024-04-03T02:57:00.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64c9488f-2672-4c33-804f-78f71f37d096 2024-04-03T02:57:04.283649849Z [2024-04-03T02:57:04.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:57:04.283974076Z [2024-04-03T02:57:04.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:56:00+00:00, run_id=scheduled__2024-04-03T02:56:00+00:00, run_start_date=2024-04-03 02:57:00.448770+00:00, run_end_date=2024-04-03 02:57:04.283577+00:00, run_duration=3.834807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:56:00+00:00, data_interval_end=2024-04-03 02:57:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:57:04.293567578Z [2024-04-03T02:57:04.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:57:00+00:00, run_after=2024-04-03T02:58:00+00:00 2024-04-03T02:57:04.336879589Z [2024-04-03T02:57:04.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:56:00+00:00 exited with status success for try_number 1 2024-04-03T02:57:04.344884346Z [2024-04-03T02:57:04.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:56:00+00:00, map_index=-1, run_start_date=2024-04-03 02:57:02.617930+00:00, run_end_date=2024-04-03 02:57:03.996646+00:00, run_duration=1.378716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:57:00.489225+00:00, queued_by_job_id=1, pid=7234 2024-04-03T02:57:05.040315964Z [2024-04-03T02:57:05.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:57:05.040569488Z [2024-04-03T02:57:05.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:56:00+00:00, run_id=scheduled__2024-04-03T02:56:00+00:00, run_start_date=2024-04-03 02:57:00.450373+00:00, run_end_date=2024-04-03 02:57:05.040228+00:00, run_duration=4.589855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:56:00+00:00, data_interval_end=2024-04-03 02:57:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:57:05.050470074Z [2024-04-03T02:57:05.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:57:00+00:00, run_after=2024-04-03T02:58:00+00:00 2024-04-03T02:57:05.080709556Z [2024-04-03T02:57:05.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:56:00+00:00 exited with status success for try_number 1 2024-04-03T02:57:05.085515116Z [2024-04-03T02:57:05.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:56:00+00:00, map_index=-1, run_start_date=2024-04-03 02:57:02.373765+00:00, run_end_date=2024-04-03 02:57:04.288372+00:00, run_duration=1.914607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:57:00.489225+00:00, queued_by_job_id=1, pid=7224 2024-04-03T02:58:00.915697203Z [2024-04-03T02:58:00.915+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:58:00.940787903Z [2024-04-03T02:58:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:58:00+00:00, run_after=2024-04-03T02:59:00+00:00 2024-04-03T02:58:00.948985106Z [2024-04-03T02:58:00.948+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:58:01.038058618Z [2024-04-03T02:58:01.037+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T02:58:01.038082313Z 2024-04-03T02:58:01.038086834Z 2024-04-03T02:58:01.038090159Z 2024-04-03T02:58:01.038150778Z [2024-04-03T02:58:01.037+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T02:58:01.038327263Z [2024-04-03T02:58:01.038+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:58:01.038443789Z [2024-04-03T02:58:01.038+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:58:01.039163920Z [2024-04-03T02:58:01.038+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:58:01.039177192Z 2024-04-03T02:58:01.039180731Z 2024-04-03T02:58:01.039183834Z 2024-04-03T02:58:01.042413659Z [2024-04-03T02:58:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:58:01.042461809Z [2024-04-03T02:58:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:58:01.042880517Z [2024-04-03T02:58:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:58:01.043068132Z [2024-04-03T02:58:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:58:01.043485606Z [2024-04-03T02:58:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:58:01.043721489Z [2024-04-03T02:58:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:58:01.506476528Z [2024-04-03T02:58:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:56:00+00:00 exited with status queued for try_number 1 2024-04-03T02:58:01.506726226Z [2024-04-03T02:58:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:57:00+00:00 exited with status queued for try_number 1 2024-04-03T02:58:01.506746048Z [2024-04-03T02:58:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:57:00+00:00 exited with status queued for try_number 1 2024-04-03T02:58:01.528073676Z [2024-04-03T02:58:01.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60b3bd47-ff85-4ce6-b3b6-18fd7d901f56 2024-04-03T02:58:01.528300900Z [2024-04-03T02:58:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24ccae67-8483-43f2-8c57-a4c3cea403e3 2024-04-03T02:58:01.528506914Z [2024-04-03T02:58:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00d6c48c-f4b2-4bf9-b518-5cc99bd9dc40 2024-04-03T02:58:02.737244629Z [2024-04-03T02:58:02.736+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:58:02.737543180Z [2024-04-03T02:58:02.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:56:00+00:00, run_id=scheduled__2024-04-03T02:56:00+00:00, run_start_date=2024-04-03 02:58:00.962390+00:00, run_end_date=2024-04-03 02:58:02.737202+00:00, run_duration=1.774812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:56:00+00:00, data_interval_end=2024-04-03 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T02:58:02.746795641Z [2024-04-03T02:58:02.746+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T02:58:00+00:00, run_after=2024-04-03T03:00:00+00:00 2024-04-03T02:58:02.809629743Z [2024-04-03T02:58:02.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:56:00+00:00 exited with status success for try_number 1 2024-04-03T02:58:02.816194204Z [2024-04-03T02:58:02.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:56:00+00:00, map_index=-1, run_start_date=2024-04-03 02:58:02.106519+00:00, run_end_date=2024-04-03 02:58:02.456102+00:00, run_duration=0.349583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:58:01.039970+00:00, queued_by_job_id=1, pid=7268 2024-04-03T02:58:05.498009612Z [2024-04-03T02:58:05.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:58:05.498176346Z [2024-04-03T02:58:05.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:57:00+00:00, run_id=scheduled__2024-04-03T02:57:00+00:00, run_start_date=2024-04-03 02:58:00.964008+00:00, run_end_date=2024-04-03 02:58:05.497760+00:00, run_duration=4.533752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:57:00+00:00, data_interval_end=2024-04-03 02:58:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:58:05.507720535Z [2024-04-03T02:58:05.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:58:00+00:00, run_after=2024-04-03T02:59:00+00:00 2024-04-03T02:58:05.513752102Z [2024-04-03T02:58:05.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:58:05.514070258Z [2024-04-03T02:58:05.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:57:00+00:00, run_id=scheduled__2024-04-03T02:57:00+00:00, run_start_date=2024-04-03 02:58:00.965461+00:00, run_end_date=2024-04-03 02:58:05.513668+00:00, run_duration=4.548207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:57:00+00:00, data_interval_end=2024-04-03 02:58:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:58:05.523783637Z [2024-04-03T02:58:05.523+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:58:00+00:00, run_after=2024-04-03T02:59:00+00:00 2024-04-03T02:58:05.553343926Z [2024-04-03T02:58:05.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:57:00+00:00 exited with status success for try_number 1 2024-04-03T02:58:05.553421518Z [2024-04-03T02:58:05.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:57:00+00:00 exited with status success for try_number 1 2024-04-03T02:58:05.562667292Z [2024-04-03T02:58:05.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:57:00+00:00, map_index=-1, run_start_date=2024-04-03 02:58:03.435650+00:00, run_end_date=2024-04-03 02:58:05.010982+00:00, run_duration=1.575332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:58:01.039970+00:00, queued_by_job_id=1, pid=7308 2024-04-03T02:58:05.563159357Z [2024-04-03T02:58:05.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:57:00+00:00, map_index=-1, run_start_date=2024-04-03 02:58:03.014321+00:00, run_end_date=2024-04-03 02:58:04.963737+00:00, run_duration=1.949416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:58:01.039970+00:00, queued_by_job_id=1, pid=7289 2024-04-03T02:59:00.077309602Z [2024-04-03T02:59:00.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T02:59:00.090335619Z [2024-04-03T02:59:00.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:59:00+00:00, run_after=2024-04-03T03:00:00+00:00 2024-04-03T02:59:00.148498863Z [2024-04-03T02:59:00.147+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T02:59:00.148526614Z 2024-04-03T02:59:00.148541543Z 2024-04-03T02:59:00.148544949Z [2024-04-03T02:59:00.148+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:59:00.148591488Z [2024-04-03T02:59:00.148+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T02:59:00.151234022Z [2024-04-03T02:59:00.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T02:59:00.151246323Z 2024-04-03T02:59:00.151256381Z 2024-04-03T02:59:00.152469063Z [2024-04-03T02:59:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:59:00.152676246Z [2024-04-03T02:59:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:59:00.152990506Z [2024-04-03T02:59:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T02:59:00.153262034Z [2024-04-03T02:59:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:59:00.477621689Z [2024-04-03T02:59:00.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:58:00+00:00 exited with status queued for try_number 1 2024-04-03T02:59:00.482995585Z [2024-04-03T02:59:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:58:00+00:00 exited with status queued for try_number 1 2024-04-03T02:59:00.499772752Z [2024-04-03T02:59:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 384a4c3b-22cf-4a05-9a13-143fb0eaf263 2024-04-03T02:59:00.500153387Z [2024-04-03T02:59:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7204d503-949b-444a-b9f2-64b492fc88a3 2024-04-03T02:59:04.703008267Z [2024-04-03T02:59:04.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:59:04.703870098Z [2024-04-03T02:59:04.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:58:00+00:00, run_id=scheduled__2024-04-03T02:58:00+00:00, run_start_date=2024-04-03 02:59:00.103505+00:00, run_end_date=2024-04-03 02:59:04.702965+00:00, run_duration=4.59946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:58:00+00:00, data_interval_end=2024-04-03 02:59:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T02:59:04.727262809Z [2024-04-03T02:59:04.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:59:00+00:00, run_after=2024-04-03T03:00:00+00:00 2024-04-03T02:59:04.737282285Z [2024-04-03T02:59:04.736+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T02:59:04.737309424Z [2024-04-03T02:59:04.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:58:00+00:00, run_id=scheduled__2024-04-03T02:58:00+00:00, run_start_date=2024-04-03 02:59:00.102260+00:00, run_end_date=2024-04-03 02:59:04.736412+00:00, run_duration=4.634152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:58:00+00:00, data_interval_end=2024-04-03 02:59:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T02:59:04.754492157Z [2024-04-03T02:59:04.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T02:59:00+00:00, run_after=2024-04-03T03:00:00+00:00 2024-04-03T02:59:04.794071797Z [2024-04-03T02:59:04.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:58:00+00:00 exited with status success for try_number 1 2024-04-03T02:59:04.794761939Z [2024-04-03T02:59:04.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:58:00+00:00 exited with status success for try_number 1 2024-04-03T02:59:04.804617624Z [2024-04-03T02:59:04.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:58:00+00:00, map_index=-1, run_start_date=2024-04-03 02:59:02.281607+00:00, run_end_date=2024-04-03 02:59:04.399924+00:00, run_duration=2.118317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:59:00.150019+00:00, queued_by_job_id=1, pid=7353 2024-04-03T02:59:04.805310336Z [2024-04-03T02:59:04.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:58:00+00:00, map_index=-1, run_start_date=2024-04-03 02:59:02.323309+00:00, run_end_date=2024-04-03 02:59:04.350284+00:00, run_duration=2.026975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 02:59:00.150019+00:00, queued_by_job_id=1, pid=7354 2024-04-03T03:00:00.418979367Z [2024-04-03T03:00:00.418+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:00:00.434682656Z [2024-04-03T03:00:00.434+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:00:00+00:00, run_after=2024-04-03T03:05:00+00:00 2024-04-03T03:00:00.441973491Z [2024-04-03T03:00:00.441+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:00:00.459681407Z [2024-04-03T03:00:00.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:00:00+00:00, run_after=2024-04-03T03:01:00+00:00 2024-04-03T03:00:00.539712375Z [2024-04-03T03:00:00.539+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T03:00:00.539743111Z 2024-04-03T03:00:00.539746804Z 2024-04-03T03:00:00.539755647Z 2024-04-03T03:00:00.539759046Z 2024-04-03T03:00:00.539982511Z [2024-04-03T03:00:00.539+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:00:00.540253313Z [2024-04-03T03:00:00.540+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:00:00.540477473Z [2024-04-03T03:00:00.540+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:00:00.540667835Z [2024-04-03T03:00:00.540+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:00:00.541537796Z [2024-04-03T03:00:00.541+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:00:00.541555643Z 2024-04-03T03:00:00.541559895Z 2024-04-03T03:00:00.541563582Z 2024-04-03T03:00:00.541566713Z 2024-04-03T03:00:00.547521817Z [2024-04-03T03:00:00.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:00:00.547893192Z [2024-04-03T03:00:00.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:00:00.548299552Z [2024-04-03T03:00:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:00:00.548503011Z [2024-04-03T03:00:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:00:00.548969518Z [2024-04-03T03:00:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:00:00.549178767Z [2024-04-03T03:00:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:00:00.549578739Z [2024-04-03T03:00:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:00:00.549792121Z [2024-04-03T03:00:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:00:00.945194033Z [2024-04-03T03:00:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status queued for try_number 1 2024-04-03T03:00:00.945224634Z [2024-04-03T03:00:00.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:58:00+00:00 exited with status queued for try_number 1 2024-04-03T03:00:00.945287177Z [2024-04-03T03:00:00.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:59:00+00:00 exited with status queued for try_number 1 2024-04-03T03:00:00.945352792Z [2024-04-03T03:00:00.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:59:00+00:00 exited with status queued for try_number 1 2024-04-03T03:00:00.965477555Z [2024-04-03T03:00:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to e20ef0e9-2fc8-4f7d-8072-33ae8b1b7443 2024-04-03T03:00:00.965536410Z [2024-04-03T03:00:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80d11709-c166-42b9-b6c8-e59cb647d831 2024-04-03T03:00:00.965650997Z [2024-04-03T03:00:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to a84688a9-af73-45d3-84b3-c642c27a7078 2024-04-03T03:00:00.965753215Z [2024-04-03T03:00:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5839388c-3cee-4581-907b-e5fee03468bf 2024-04-03T03:00:03.375630155Z [2024-04-03T03:00:03.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:00:03.377420746Z [2024-04-03T03:00:03.377+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 02:58:00+00:00, run_id=scheduled__2024-04-03T02:58:00+00:00, run_start_date=2024-04-03 03:00:00.471585+00:00, run_end_date=2024-04-03 03:00:03.375559+00:00, run_duration=2.903974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:58:00+00:00, data_interval_end=2024-04-03 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:00:03.393476527Z [2024-04-03T03:00:03.393+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:00:00+00:00, run_after=2024-04-03T03:02:00+00:00 2024-04-03T03:00:03.536739203Z [2024-04-03T03:00:03.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T02:58:00+00:00 exited with status success for try_number 1 2024-04-03T03:00:03.547045881Z [2024-04-03T03:00:03.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T02:58:00+00:00, map_index=-1, run_start_date=2024-04-03 03:00:02.390677+00:00, run_end_date=2024-04-03 03:00:02.811007+00:00, run_duration=0.42033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:00:00.542635+00:00, queued_by_job_id=1, pid=7392 2024-04-03T03:00:04.670646547Z [2024-04-03T03:00:04.670+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:00:04.670683334Z 2024-04-03T03:00:04.670799519Z [2024-04-03T03:00:04.670+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:00:04.671396261Z [2024-04-03T03:00:04.671+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:00:04.671404972Z 2024-04-03T03:00:04.673611164Z [2024-04-03T03:00:04.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:00:04.673807794Z [2024-04-03T03:00:04.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:00:04.728751997Z [2024-04-03T03:00:04.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status queued for try_number 1 2024-04-03T03:00:04.729132945Z [2024-04-03T03:00:04.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status success for try_number 1 2024-04-03T03:00:04.735811530Z [2024-04-03T03:00:04.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to d381b77c-f7a2-4d65-aa61-240cd42691e3 2024-04-03T03:00:04.736090735Z [2024-04-03T03:00:04.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T02:55:00+00:00, map_index=-1, run_start_date=2024-04-03 03:00:03.386157+00:00, run_end_date=2024-04-03 03:00:04.047802+00:00, run_duration=0.661645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:00:00.542635+00:00, queued_by_job_id=1, pid=7430 2024-04-03T03:00:05.886442704Z [2024-04-03T03:00:05.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:00:05.886854152Z [2024-04-03T03:00:05.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:59:00+00:00, run_id=scheduled__2024-04-03T02:59:00+00:00, run_start_date=2024-04-03 03:00:00.472680+00:00, run_end_date=2024-04-03 03:00:05.886357+00:00, run_duration=5.413677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:59:00+00:00, data_interval_end=2024-04-03 03:00:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:00:05.899477889Z [2024-04-03T03:00:05.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:00:00+00:00, run_after=2024-04-03T03:01:00+00:00 2024-04-03T03:00:05.952858392Z [2024-04-03T03:00:05.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:59:00+00:00 exited with status success for try_number 1 2024-04-03T03:00:05.958003456Z [2024-04-03T03:00:05.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:59:00+00:00, map_index=-1, run_start_date=2024-04-03 03:00:03.617894+00:00, run_end_date=2024-04-03 03:00:05.254496+00:00, run_duration=1.636602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:00:00.542635+00:00, queued_by_job_id=1, pid=7431 2024-04-03T03:00:06.235592054Z [2024-04-03T03:00:06.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:00:06.236064962Z [2024-04-03T03:00:06.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:59:00+00:00, run_id=scheduled__2024-04-03T02:59:00+00:00, run_start_date=2024-04-03 03:00:00.473808+00:00, run_end_date=2024-04-03 03:00:06.235752+00:00, run_duration=5.761944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:59:00+00:00, data_interval_end=2024-04-03 03:00:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:00:06.245598638Z [2024-04-03T03:00:06.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:00:00+00:00, run_after=2024-04-03T03:01:00+00:00 2024-04-03T03:00:06.305623055Z [2024-04-03T03:00:06.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T02:59:00+00:00 exited with status success for try_number 1 2024-04-03T03:00:06.316522781Z [2024-04-03T03:00:06.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T02:59:00+00:00, map_index=-1, run_start_date=2024-04-03 03:00:03.306412+00:00, run_end_date=2024-04-03 03:00:06.045995+00:00, run_duration=2.739583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:00:00.542635+00:00, queued_by_job_id=1, pid=7429 2024-04-03T03:00:07.409430547Z [2024-04-03T03:00:07.409+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:00:07.409456987Z 2024-04-03T03:00:07.409498675Z [2024-04-03T03:00:07.409+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:00:07.410077512Z [2024-04-03T03:00:07.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:00:07.410086034Z 2024-04-03T03:00:07.412839177Z [2024-04-03T03:00:07.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:00:07.412932679Z [2024-04-03T03:00:07.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:00:07.451423552Z [2024-04-03T03:00:07.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status queued for try_number 1 2024-04-03T03:00:07.451822343Z [2024-04-03T03:00:07.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status success for try_number 1 2024-04-03T03:00:07.458266468Z [2024-04-03T03:00:07.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a3942d1-6a1d-46e0-be9e-d12ad543699d 2024-04-03T03:00:07.458422995Z [2024-04-03T03:00:07.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T02:55:00+00:00, map_index=-1, run_start_date=2024-04-03 03:00:06.588551+00:00, run_end_date=2024-04-03 03:00:06.975627+00:00, run_duration=0.387076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:00:04.671773+00:00, queued_by_job_id=1, pid=7470 2024-04-03T03:00:09.705159465Z [2024-04-03T03:00:09.704+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:00:09.705219643Z 2024-04-03T03:00:09.705349040Z [2024-04-03T03:00:09.705+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:00:09.706259671Z [2024-04-03T03:00:09.705+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:00:09.706274583Z 2024-04-03T03:00:09.708722899Z [2024-04-03T03:00:09.708+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:00:09.709035821Z [2024-04-03T03:00:09.708+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:00:09.786222470Z [2024-04-03T03:00:09.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status queued for try_number 1 2024-04-03T03:00:09.786263532Z [2024-04-03T03:00:09.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status success for try_number 1 2024-04-03T03:00:09.827948132Z [2024-04-03T03:00:09.826+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc374db9-d833-4479-bda5-8a3d12665e5e 2024-04-03T03:00:09.827983827Z [2024-04-03T03:00:09.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T02:55:00+00:00, map_index=0, run_start_date=2024-04-03 03:00:09.279719+00:00, run_end_date=2024-04-03 03:00:09.563032+00:00, run_duration=0.283313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:00:07.410430+00:00, queued_by_job_id=1, pid=7482 2024-04-03T03:00:13.232918997Z [2024-04-03T03:00:13.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:00:13.233152527Z [2024-04-03T03:00:13.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 02:55:00+00:00, run_id=scheduled__2024-04-03T02:55:00+00:00, run_start_date=2024-04-03 03:00:00.470108+00:00, run_end_date=2024-04-03 03:00:13.232793+00:00, run_duration=12.762685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 02:55:00+00:00, data_interval_end=2024-04-03 03:00:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:00:13.254693869Z [2024-04-03T03:00:13.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:00:00+00:00, run_after=2024-04-03T03:05:00+00:00 2024-04-03T03:00:13.359800993Z [2024-04-03T03:00:13.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T02:55:00+00:00 exited with status success for try_number 1 2024-04-03T03:00:13.385223098Z [2024-04-03T03:00:13.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T02:55:00+00:00, map_index=-1, run_start_date=2024-04-03 03:00:11.630496+00:00, run_end_date=2024-04-03 03:00:12.141607+00:00, run_duration=0.511111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:00:09.706817+00:00, queued_by_job_id=1, pid=7494 2024-04-03T03:01:00.374904529Z [2024-04-03T03:01:00.374+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:01:00.387506889Z [2024-04-03T03:01:00.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:01:00+00:00, run_after=2024-04-03T03:02:00+00:00 2024-04-03T03:01:00.434639159Z [2024-04-03T03:01:00.434+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:01:00.434658552Z 2024-04-03T03:01:00.434662861Z 2024-04-03T03:01:00.434899441Z [2024-04-03T03:01:00.434+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:01:00.435107234Z [2024-04-03T03:01:00.434+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:01:00.435817223Z [2024-04-03T03:01:00.435+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:01:00.435828097Z 2024-04-03T03:01:00.435831622Z 2024-04-03T03:01:00.438300585Z [2024-04-03T03:01:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:01:00.438547131Z [2024-04-03T03:01:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:01:00.438889788Z [2024-04-03T03:01:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:01:00.439096512Z [2024-04-03T03:01:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:01:00.583524402Z [2024-04-03T03:01:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status queued for try_number 1 2024-04-03T03:01:00.583621458Z [2024-04-03T03:01:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status queued for try_number 1 2024-04-03T03:01:00.589726854Z [2024-04-03T03:01:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07e92975-089d-4ec2-b7ab-68992e83aa72 2024-04-03T03:01:00.589796876Z [2024-04-03T03:01:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0773f5b-e0f3-4d61-8dd7-1e7b4767178e 2024-04-03T03:01:04.390150545Z [2024-04-03T03:01:04.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:01:04.390706960Z [2024-04-03T03:01:04.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:00:00+00:00, run_id=scheduled__2024-04-03T03:00:00+00:00, run_start_date=2024-04-03 03:01:00.397728+00:00, run_end_date=2024-04-03 03:01:04.390059+00:00, run_duration=3.992331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:00:00+00:00, data_interval_end=2024-04-03 03:01:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:01:04.415553897Z [2024-04-03T03:01:04.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:01:00+00:00, run_after=2024-04-03T03:02:00+00:00 2024-04-03T03:01:04.466239450Z [2024-04-03T03:01:04.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status success for try_number 1 2024-04-03T03:01:04.474393790Z [2024-04-03T03:01:04.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:00:00+00:00, map_index=-1, run_start_date=2024-04-03 03:01:02.419867+00:00, run_end_date=2024-04-03 03:01:03.840963+00:00, run_duration=1.421096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:01:00.436362+00:00, queued_by_job_id=1, pid=7530 2024-04-03T03:01:05.529863228Z [2024-04-03T03:01:05.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:01:05.530132767Z [2024-04-03T03:01:05.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:00:00+00:00, run_id=scheduled__2024-04-03T03:00:00+00:00, run_start_date=2024-04-03 03:01:00.399187+00:00, run_end_date=2024-04-03 03:01:05.529817+00:00, run_duration=5.13063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:00:00+00:00, data_interval_end=2024-04-03 03:01:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:01:05.539755640Z [2024-04-03T03:01:05.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:01:00+00:00, run_after=2024-04-03T03:02:00+00:00 2024-04-03T03:01:05.574387590Z [2024-04-03T03:01:05.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status success for try_number 1 2024-04-03T03:01:05.581462522Z [2024-04-03T03:01:05.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:00:00+00:00, map_index=-1, run_start_date=2024-04-03 03:01:02.430219+00:00, run_end_date=2024-04-03 03:01:04.784181+00:00, run_duration=2.353962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:01:00.436362+00:00, queued_by_job_id=1, pid=7531 2024-04-03T03:01:35.841318415Z [2024-04-03T03:01:35.840+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:02:00.114927663Z [2024-04-03T03:02:00.114+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:02:00.130627683Z [2024-04-03T03:02:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:02:00+00:00, run_after=2024-04-03T03:03:00+00:00 2024-04-03T03:02:00.154063377Z [2024-04-03T03:02:00.153+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:02:00.232459241Z [2024-04-03T03:02:00.232+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:02:00.232484693Z 2024-04-03T03:02:00.232489123Z 2024-04-03T03:02:00.232492517Z 2024-04-03T03:02:00.232885448Z [2024-04-03T03:02:00.232+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:02:00.233053938Z [2024-04-03T03:02:00.232+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:02:00.233223002Z [2024-04-03T03:02:00.233+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:02:00.233931173Z [2024-04-03T03:02:00.233+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:02:00.233940336Z 2024-04-03T03:02:00.233944567Z 2024-04-03T03:02:00.233948083Z 2024-04-03T03:02:00.237776930Z [2024-04-03T03:02:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:02:00.238029421Z [2024-04-03T03:02:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:02:00.238284905Z [2024-04-03T03:02:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:02:00.238439695Z [2024-04-03T03:02:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:02:00.238722415Z [2024-04-03T03:02:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:02:00.238825146Z [2024-04-03T03:02:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:02:00.539902077Z [2024-04-03T03:02:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status queued for try_number 1 2024-04-03T03:02:00.540017143Z [2024-04-03T03:02:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:01:00+00:00 exited with status queued for try_number 1 2024-04-03T03:02:00.540140248Z [2024-04-03T03:02:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:01:00+00:00 exited with status queued for try_number 1 2024-04-03T03:02:00.548885393Z [2024-04-03T03:02:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdd7404c-c621-4db2-a959-8bffa1da4729 2024-04-03T03:02:00.549084889Z [2024-04-03T03:02:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 867e1a76-769c-4770-b0ff-e02f8fc559c9 2024-04-03T03:02:00.549286160Z [2024-04-03T03:02:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0685d721-582e-4523-8f68-023a6aef6ab5 2024-04-03T03:02:02.697910692Z [2024-04-03T03:02:02.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:02:02.698518819Z [2024-04-03T03:02:02.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:00:00+00:00, run_id=scheduled__2024-04-03T03:00:00+00:00, run_start_date=2024-04-03 03:02:00.171644+00:00, run_end_date=2024-04-03 03:02:02.697997+00:00, run_duration=2.526353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:00:00+00:00, data_interval_end=2024-04-03 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:02:02.715471328Z [2024-04-03T03:02:02.714+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:02:00+00:00, run_after=2024-04-03T03:04:00+00:00 2024-04-03T03:02:02.846876610Z [2024-04-03T03:02:02.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status success for try_number 1 2024-04-03T03:02:02.856649660Z [2024-04-03T03:02:02.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:00:00+00:00, map_index=-1, run_start_date=2024-04-03 03:02:01.820801+00:00, run_end_date=2024-04-03 03:02:02.372394+00:00, run_duration=0.551593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:02:00.234770+00:00, queued_by_job_id=1, pid=7567 2024-04-03T03:02:05.603032926Z [2024-04-03T03:02:05.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:02:05.603173823Z [2024-04-03T03:02:05.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:01:00+00:00, run_id=scheduled__2024-04-03T03:01:00+00:00, run_start_date=2024-04-03 03:02:00.173336+00:00, run_end_date=2024-04-03 03:02:05.602938+00:00, run_duration=5.429602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:01:00+00:00, data_interval_end=2024-04-03 03:02:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:02:05.611397141Z [2024-04-03T03:02:05.611+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:02:00+00:00, run_after=2024-04-03T03:03:00+00:00 2024-04-03T03:02:05.617661307Z [2024-04-03T03:02:05.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:02:05.617954135Z [2024-04-03T03:02:05.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:01:00+00:00, run_id=scheduled__2024-04-03T03:01:00+00:00, run_start_date=2024-04-03 03:02:00.174514+00:00, run_end_date=2024-04-03 03:02:05.617607+00:00, run_duration=5.443093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:01:00+00:00, data_interval_end=2024-04-03 03:02:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:02:05.628033356Z [2024-04-03T03:02:05.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:02:00+00:00, run_after=2024-04-03T03:03:00+00:00 2024-04-03T03:02:05.681399395Z [2024-04-03T03:02:05.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:01:00+00:00 exited with status success for try_number 1 2024-04-03T03:02:05.689294712Z [2024-04-03T03:02:05.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:01:00+00:00, map_index=-1, run_start_date=2024-04-03 03:02:03.205460+00:00, run_end_date=2024-04-03 03:02:05.079589+00:00, run_duration=1.874129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:02:00.234770+00:00, queued_by_job_id=1, pid=7597 2024-04-03T03:02:06.753791342Z [2024-04-03T03:02:06.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:01:00+00:00 exited with status success for try_number 1 2024-04-03T03:02:06.758304958Z [2024-04-03T03:02:06.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:01:00+00:00, map_index=-1, run_start_date=2024-04-03 03:02:03.473458+00:00, run_end_date=2024-04-03 03:02:05.539148+00:00, run_duration=2.06569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:02:00.234770+00:00, queued_by_job_id=1, pid=7598 2024-04-03T03:03:00.435209913Z [2024-04-03T03:03:00.434+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:03:00.453599769Z [2024-04-03T03:03:00.453+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:03:00+00:00, run_after=2024-04-03T03:04:00+00:00 2024-04-03T03:03:00.515303591Z [2024-04-03T03:03:00.514+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:03:00.515338508Z 2024-04-03T03:03:00.515342460Z 2024-04-03T03:03:00.515407072Z [2024-04-03T03:03:00.515+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:03:00.515540756Z [2024-04-03T03:03:00.515+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:03:00.516243215Z [2024-04-03T03:03:00.516+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:03:00.516263802Z 2024-04-03T03:03:00.516267629Z 2024-04-03T03:03:00.519324265Z [2024-04-03T03:03:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:03:00.519477611Z [2024-04-03T03:03:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:03:00.519742978Z [2024-04-03T03:03:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:03:00.519906963Z [2024-04-03T03:03:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:03:00.867023073Z [2024-04-03T03:03:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:02:00+00:00 exited with status queued for try_number 1 2024-04-03T03:03:00.867046695Z [2024-04-03T03:03:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:02:00+00:00 exited with status queued for try_number 1 2024-04-03T03:03:00.878683709Z [2024-04-03T03:03:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to d69d07e8-6026-4f68-9d16-f558a9f8f1be 2024-04-03T03:03:00.878706477Z [2024-04-03T03:03:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67923667-84e5-496a-be53-68677cc3c671 2024-04-03T03:03:05.232217202Z [2024-04-03T03:03:05.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:03:05.232387871Z [2024-04-03T03:03:05.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:02:00+00:00, run_id=scheduled__2024-04-03T03:02:00+00:00, run_start_date=2024-04-03 03:03:00.467571+00:00, run_end_date=2024-04-03 03:03:05.232106+00:00, run_duration=4.764535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:02:00+00:00, data_interval_end=2024-04-03 03:03:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:03:05.241177582Z [2024-04-03T03:03:05.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:03:00+00:00, run_after=2024-04-03T03:04:00+00:00 2024-04-03T03:03:05.247729471Z [2024-04-03T03:03:05.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:03:05.247900658Z [2024-04-03T03:03:05.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:02:00+00:00, run_id=scheduled__2024-04-03T03:02:00+00:00, run_start_date=2024-04-03 03:03:00.466413+00:00, run_end_date=2024-04-03 03:03:05.247651+00:00, run_duration=4.781238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:02:00+00:00, data_interval_end=2024-04-03 03:03:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:03:05.258438416Z [2024-04-03T03:03:05.258+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:03:00+00:00, run_after=2024-04-03T03:04:00+00:00 2024-04-03T03:03:05.284902483Z [2024-04-03T03:03:05.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:02:00+00:00 exited with status success for try_number 1 2024-04-03T03:03:05.284956543Z [2024-04-03T03:03:05.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:02:00+00:00 exited with status success for try_number 1 2024-04-03T03:03:05.292114918Z [2024-04-03T03:03:05.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:02:00+00:00, map_index=-1, run_start_date=2024-04-03 03:03:03.331012+00:00, run_end_date=2024-04-03 03:03:05.046341+00:00, run_duration=1.715329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:03:00.516695+00:00, queued_by_job_id=1, pid=7653 2024-04-03T03:03:05.292292034Z [2024-04-03T03:03:05.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:02:00+00:00, map_index=-1, run_start_date=2024-04-03 03:03:03.014523+00:00, run_end_date=2024-04-03 03:03:04.657651+00:00, run_duration=1.643128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:03:00.516695+00:00, queued_by_job_id=1, pid=7643 2024-04-03T03:04:00.805887311Z [2024-04-03T03:04:00.805+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:04:00.819164109Z [2024-04-03T03:04:00.818+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:04:00.843735211Z [2024-04-03T03:04:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:04:00+00:00, run_after=2024-04-03T03:05:00+00:00 2024-04-03T03:04:00.916093367Z [2024-04-03T03:04:00.915+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:04:00.916115348Z 2024-04-03T03:04:00.916119964Z 2024-04-03T03:04:00.916123292Z 2024-04-03T03:04:00.916440538Z [2024-04-03T03:04:00.916+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:04:00.916681679Z [2024-04-03T03:04:00.916+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:04:00.916911709Z [2024-04-03T03:04:00.916+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:04:00.917543246Z [2024-04-03T03:04:00.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:04:00.917554178Z 2024-04-03T03:04:00.917557691Z 2024-04-03T03:04:00.917560936Z 2024-04-03T03:04:00.921159089Z [2024-04-03T03:04:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:04:00.921508127Z [2024-04-03T03:04:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:04:00.922077345Z [2024-04-03T03:04:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:04:00.922418090Z [2024-04-03T03:04:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:04:00.922828723Z [2024-04-03T03:04:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:04:00.923154935Z [2024-04-03T03:04:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:04:01.269460073Z [2024-04-03T03:04:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:02:00+00:00 exited with status queued for try_number 1 2024-04-03T03:04:01.269531960Z [2024-04-03T03:04:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:03:00+00:00 exited with status queued for try_number 1 2024-04-03T03:04:01.269536560Z [2024-04-03T03:04:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:03:00+00:00 exited with status queued for try_number 1 2024-04-03T03:04:01.276733519Z [2024-04-03T03:04:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb99f655-9de2-4869-bc6c-55a2f6e5210f 2024-04-03T03:04:01.276796225Z [2024-04-03T03:04:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25eba783-a522-4325-9282-5422a8a2ec74 2024-04-03T03:04:01.276879429Z [2024-04-03T03:04:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3575cda6-165c-4c92-9e1d-f66af9fd7535 2024-04-03T03:04:02.216195372Z [2024-04-03T03:04:02.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:04:02.217031940Z [2024-04-03T03:04:02.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:02:00+00:00, run_id=scheduled__2024-04-03T03:02:00+00:00, run_start_date=2024-04-03 03:04:00.855342+00:00, run_end_date=2024-04-03 03:04:02.216456+00:00, run_duration=1.361114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:02:00+00:00, data_interval_end=2024-04-03 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:04:02.230211817Z [2024-04-03T03:04:02.229+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:04:00+00:00, run_after=2024-04-03T03:06:00+00:00 2024-04-03T03:04:02.458228896Z [2024-04-03T03:04:02.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:02:00+00:00 exited with status success for try_number 1 2024-04-03T03:04:02.470032267Z [2024-04-03T03:04:02.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:02:00+00:00, map_index=-1, run_start_date=2024-04-03 03:04:01.821236+00:00, run_end_date=2024-04-03 03:04:02.198644+00:00, run_duration=0.377408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:04:00.918391+00:00, queued_by_job_id=1, pid=7689 2024-04-03T03:04:05.746019425Z [2024-04-03T03:04:05.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:04:05.746519206Z [2024-04-03T03:04:05.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:03:00+00:00, run_id=scheduled__2024-04-03T03:03:00+00:00, run_start_date=2024-04-03 03:04:00.857769+00:00, run_end_date=2024-04-03 03:04:05.745894+00:00, run_duration=4.888125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:03:00+00:00, data_interval_end=2024-04-03 03:04:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:04:05.755853505Z [2024-04-03T03:04:05.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:04:00+00:00, run_after=2024-04-03T03:05:00+00:00 2024-04-03T03:04:05.761319129Z [2024-04-03T03:04:05.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:04:05.761698825Z [2024-04-03T03:04:05.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:03:00+00:00, run_id=scheduled__2024-04-03T03:03:00+00:00, run_start_date=2024-04-03 03:04:00.856650+00:00, run_end_date=2024-04-03 03:04:05.761193+00:00, run_duration=4.904543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:03:00+00:00, data_interval_end=2024-04-03 03:04:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:04:05.770789340Z [2024-04-03T03:04:05.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:04:00+00:00, run_after=2024-04-03T03:05:00+00:00 2024-04-03T03:04:05.811679435Z [2024-04-03T03:04:05.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:03:00+00:00 exited with status success for try_number 1 2024-04-03T03:04:05.811874300Z [2024-04-03T03:04:05.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:03:00+00:00 exited with status success for try_number 1 2024-04-03T03:04:05.818286862Z [2024-04-03T03:04:05.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:03:00+00:00, map_index=-1, run_start_date=2024-04-03 03:04:03.160793+00:00, run_end_date=2024-04-03 03:04:05.417627+00:00, run_duration=2.256834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:04:00.918391+00:00, queued_by_job_id=1, pid=7720 2024-04-03T03:04:05.818721345Z [2024-04-03T03:04:05.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:03:00+00:00, map_index=-1, run_start_date=2024-04-03 03:04:03.169288+00:00, run_end_date=2024-04-03 03:04:05.057204+00:00, run_duration=1.887916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:04:00.918391+00:00, queued_by_job_id=1, pid=7719 2024-04-03T03:05:00.414976308Z [2024-04-03T03:05:00.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:05:00+00:00, run_after=2024-04-03T03:10:00+00:00 2024-04-03T03:05:00.429114734Z [2024-04-03T03:05:00.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:05:00+00:00, run_after=2024-04-03T03:06:00+00:00 2024-04-03T03:05:00.436590516Z [2024-04-03T03:05:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:05:00.543847208Z [2024-04-03T03:05:00.543+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:05:00.543873494Z 2024-04-03T03:05:00.543883165Z 2024-04-03T03:05:00.543886664Z 2024-04-03T03:05:00.544306383Z [2024-04-03T03:05:00.544+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:05:00.544670598Z [2024-04-03T03:05:00.544+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:05:00.544898915Z [2024-04-03T03:05:00.544+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:05:00.545622544Z [2024-04-03T03:05:00.545+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:05:00.545634672Z 2024-04-03T03:05:00.545639831Z 2024-04-03T03:05:00.545652482Z 2024-04-03T03:05:00.555661273Z [2024-04-03T03:05:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:05:00.556010590Z [2024-04-03T03:05:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:05:00.556517831Z [2024-04-03T03:05:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:05:00.556681581Z [2024-04-03T03:05:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:05:00.556928480Z [2024-04-03T03:05:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:05:00.557257340Z [2024-04-03T03:05:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:05:01.041411885Z [2024-04-03T03:05:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status queued for try_number 1 2024-04-03T03:05:01.041952690Z [2024-04-03T03:05:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:04:00+00:00 exited with status queued for try_number 1 2024-04-03T03:05:01.042189149Z [2024-04-03T03:05:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:04:00+00:00 exited with status queued for try_number 1 2024-04-03T03:05:01.057122149Z [2024-04-03T03:05:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92dd5fad-1892-4f88-a4c0-4b87d70422ed 2024-04-03T03:05:01.057335797Z [2024-04-03T03:05:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7079b945-8ce3-482e-88ec-d3e9e45dc160 2024-04-03T03:05:01.057619707Z [2024-04-03T03:05:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to f51220dc-404b-4aa9-b3ad-35b28a3f97ea 2024-04-03T03:05:04.620654269Z [2024-04-03T03:05:04.620+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:05:04.620702539Z 2024-04-03T03:05:04.620706495Z [2024-04-03T03:05:04.620+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:05:04.621236482Z [2024-04-03T03:05:04.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:05:04.621243500Z 2024-04-03T03:05:04.623865308Z [2024-04-03T03:05:04.623+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:05:04.624128701Z [2024-04-03T03:05:04.623+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:05:04.690159137Z [2024-04-03T03:05:04.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status queued for try_number 1 2024-04-03T03:05:04.690346794Z [2024-04-03T03:05:04.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status success for try_number 1 2024-04-03T03:05:04.698887603Z [2024-04-03T03:05:04.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb53411f-c366-42a5-9011-2557319fb048 2024-04-03T03:05:04.699882019Z [2024-04-03T03:05:04.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:00:00+00:00, map_index=-1, run_start_date=2024-04-03 03:05:03.140779+00:00, run_end_date=2024-04-03 03:05:03.963760+00:00, run_duration=0.822981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:05:00.547358+00:00, queued_by_job_id=1, pid=7786 2024-04-03T03:05:05.836754689Z [2024-04-03T03:05:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:05:05.837255032Z [2024-04-03T03:05:05.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:04:00+00:00, run_id=scheduled__2024-04-03T03:04:00+00:00, run_start_date=2024-04-03 03:05:00.453729+00:00, run_end_date=2024-04-03 03:05:05.836627+00:00, run_duration=5.382898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:04:00+00:00, data_interval_end=2024-04-03 03:05:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:05:05.847238281Z [2024-04-03T03:05:05.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:05:00+00:00, run_after=2024-04-03T03:06:00+00:00 2024-04-03T03:05:05.853083207Z [2024-04-03T03:05:05.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:05:05.853375902Z [2024-04-03T03:05:05.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:04:00+00:00, run_id=scheduled__2024-04-03T03:04:00+00:00, run_start_date=2024-04-03 03:05:00.454772+00:00, run_end_date=2024-04-03 03:05:05.852984+00:00, run_duration=5.398212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:04:00+00:00, data_interval_end=2024-04-03 03:05:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:05:05.864399939Z [2024-04-03T03:05:05.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:05:00+00:00, run_after=2024-04-03T03:06:00+00:00 2024-04-03T03:05:05.922986269Z [2024-04-03T03:05:05.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:04:00+00:00 exited with status success for try_number 1 2024-04-03T03:05:05.923161922Z [2024-04-03T03:05:05.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:04:00+00:00 exited with status success for try_number 1 2024-04-03T03:05:05.929890076Z [2024-04-03T03:05:05.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:04:00+00:00, map_index=-1, run_start_date=2024-04-03 03:05:03.018976+00:00, run_end_date=2024-04-03 03:05:04.750319+00:00, run_duration=1.731343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:05:00.547358+00:00, queued_by_job_id=1, pid=7785 2024-04-03T03:05:05.930179957Z [2024-04-03T03:05:05.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:04:00+00:00, map_index=-1, run_start_date=2024-04-03 03:05:03.230517+00:00, run_end_date=2024-04-03 03:05:05.049316+00:00, run_duration=1.818799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:05:00.547358+00:00, queued_by_job_id=1, pid=7787 2024-04-03T03:05:08.060746545Z [2024-04-03T03:05:08.060+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:05:08.060785378Z 2024-04-03T03:05:08.060852313Z [2024-04-03T03:05:08.060+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:05:08.061561871Z [2024-04-03T03:05:08.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:05:08.061586882Z 2024-04-03T03:05:08.064274515Z [2024-04-03T03:05:08.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:05:08.064411637Z [2024-04-03T03:05:08.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:05:08.114840720Z [2024-04-03T03:05:08.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status queued for try_number 1 2024-04-03T03:05:08.114906141Z [2024-04-03T03:05:08.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status success for try_number 1 2024-04-03T03:05:08.121963729Z [2024-04-03T03:05:08.121+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26c9fd85-fc10-4ba2-b3f7-66f63f6e3fe6 2024-04-03T03:05:08.122202935Z [2024-04-03T03:05:08.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:00:00+00:00, map_index=-1, run_start_date=2024-04-03 03:05:06.465401+00:00, run_end_date=2024-04-03 03:05:06.814773+00:00, run_duration=0.349372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:05:04.621666+00:00, queued_by_job_id=1, pid=7826 2024-04-03T03:05:10.832121835Z [2024-04-03T03:05:10.831+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:05:10.832157187Z 2024-04-03T03:05:10.832296210Z [2024-04-03T03:05:10.832+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:05:10.832880585Z [2024-04-03T03:05:10.832+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:05:10.832889469Z 2024-04-03T03:05:10.836581083Z [2024-04-03T03:05:10.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:05:10.836819038Z [2024-04-03T03:05:10.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:05:10.897288863Z [2024-04-03T03:05:10.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status queued for try_number 1 2024-04-03T03:05:10.897586850Z [2024-04-03T03:05:10.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status success for try_number 1 2024-04-03T03:05:10.903806116Z [2024-04-03T03:05:10.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ac2cc54-7644-4d06-899f-101f84522507 2024-04-03T03:05:10.903912964Z [2024-04-03T03:05:10.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:00:00+00:00, map_index=0, run_start_date=2024-04-03 03:05:09.715802+00:00, run_end_date=2024-04-03 03:05:10.124985+00:00, run_duration=0.409183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:05:08.061879+00:00, queued_by_job_id=1, pid=7838 2024-04-03T03:05:13.700420288Z [2024-04-03T03:05:13.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:05:13.700879491Z [2024-04-03T03:05:13.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:00:00+00:00, run_id=scheduled__2024-04-03T03:00:00+00:00, run_start_date=2024-04-03 03:05:00.452485+00:00, run_end_date=2024-04-03 03:05:13.700335+00:00, run_duration=13.24785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:00:00+00:00, data_interval_end=2024-04-03 03:05:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:05:13.707253699Z [2024-04-03T03:05:13.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:05:00+00:00, run_after=2024-04-03T03:10:00+00:00 2024-04-03T03:05:13.736522158Z [2024-04-03T03:05:13.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:00:00+00:00 exited with status success for try_number 1 2024-04-03T03:05:13.743383565Z [2024-04-03T03:05:13.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:00:00+00:00, map_index=-1, run_start_date=2024-04-03 03:05:12.874478+00:00, run_end_date=2024-04-03 03:05:13.303478+00:00, run_duration=0.429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:05:10.833295+00:00, queued_by_job_id=1, pid=7850 2024-04-03T03:06:00.386057041Z [2024-04-03T03:06:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:06:00+00:00, run_after=2024-04-03T03:07:00+00:00 2024-04-03T03:06:00.395661655Z [2024-04-03T03:06:00.394+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:06:00.413379676Z [2024-04-03T03:06:00.413+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:06:00.504956133Z [2024-04-03T03:06:00.504+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:06:00.504980491Z 2024-04-03T03:06:00.504984838Z 2024-04-03T03:06:00.504988014Z 2024-04-03T03:06:00.505228208Z [2024-04-03T03:06:00.505+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:06:00.505521129Z [2024-04-03T03:06:00.505+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:06:00.505850586Z [2024-04-03T03:06:00.505+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:06:00.506688853Z [2024-04-03T03:06:00.506+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:06:00.506705215Z 2024-04-03T03:06:00.506710163Z 2024-04-03T03:06:00.506714753Z 2024-04-03T03:06:00.510876564Z [2024-04-03T03:06:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:06:00.511138354Z [2024-04-03T03:06:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:06:00.511625841Z [2024-04-03T03:06:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:06:00.511887475Z [2024-04-03T03:06:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:06:00.512244989Z [2024-04-03T03:06:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:06:00.512565588Z [2024-04-03T03:06:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:06:00.970465106Z [2024-04-03T03:06:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:04:00+00:00 exited with status queued for try_number 1 2024-04-03T03:06:00.971909852Z [2024-04-03T03:06:00.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status queued for try_number 1 2024-04-03T03:06:00.972117167Z [2024-04-03T03:06:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status queued for try_number 1 2024-04-03T03:06:00.980711302Z [2024-04-03T03:06:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to d27b501d-23fb-4ddc-aa6e-6552e43a786a 2024-04-03T03:06:00.983173730Z [2024-04-03T03:06:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f1f7a3a-e2ff-429c-82b0-02541d08e033 2024-04-03T03:06:00.983437822Z [2024-04-03T03:06:00.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d5f15d3-b922-4dcb-9c5c-ab6be9ebc6e3 2024-04-03T03:06:02.897880967Z [2024-04-03T03:06:02.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:06:02.898103886Z [2024-04-03T03:06:02.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:04:00+00:00, run_id=scheduled__2024-04-03T03:04:00+00:00, run_start_date=2024-04-03 03:06:00.426407+00:00, run_end_date=2024-04-03 03:06:02.897792+00:00, run_duration=2.471385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:04:00+00:00, data_interval_end=2024-04-03 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:06:02.905884691Z [2024-04-03T03:06:02.905+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:06:00+00:00, run_after=2024-04-03T03:08:00+00:00 2024-04-03T03:06:02.984507092Z [2024-04-03T03:06:02.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:04:00+00:00 exited with status success for try_number 1 2024-04-03T03:06:02.992359135Z [2024-04-03T03:06:02.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:04:00+00:00, map_index=-1, run_start_date=2024-04-03 03:06:01.652868+00:00, run_end_date=2024-04-03 03:06:02.141879+00:00, run_duration=0.489011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:06:00.507781+00:00, queued_by_job_id=1, pid=7867 2024-04-03T03:06:05.525613995Z [2024-04-03T03:06:05.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:06:05.526154142Z [2024-04-03T03:06:05.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:05:00+00:00, run_id=scheduled__2024-04-03T03:05:00+00:00, run_start_date=2024-04-03 03:06:00.427596+00:00, run_end_date=2024-04-03 03:06:05.525692+00:00, run_duration=5.098096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:05:00+00:00, data_interval_end=2024-04-03 03:06:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:06:05.536046395Z [2024-04-03T03:06:05.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:06:00+00:00, run_after=2024-04-03T03:07:00+00:00 2024-04-03T03:06:05.585668048Z [2024-04-03T03:06:05.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status success for try_number 1 2024-04-03T03:06:05.592123647Z [2024-04-03T03:06:05.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:05:00+00:00, map_index=-1, run_start_date=2024-04-03 03:06:03.067785+00:00, run_end_date=2024-04-03 03:06:04.864343+00:00, run_duration=1.796558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:06:00.507781+00:00, queued_by_job_id=1, pid=7897 2024-04-03T03:06:06.673866927Z [2024-04-03T03:06:06.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:06:06.674824963Z [2024-04-03T03:06:06.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:05:00+00:00, run_id=scheduled__2024-04-03T03:05:00+00:00, run_start_date=2024-04-03 03:06:00.428577+00:00, run_end_date=2024-04-03 03:06:06.673545+00:00, run_duration=6.244968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:05:00+00:00, data_interval_end=2024-04-03 03:06:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:06:06.710965310Z [2024-04-03T03:06:06.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:06:00+00:00, run_after=2024-04-03T03:07:00+00:00 2024-04-03T03:06:06.765336053Z [2024-04-03T03:06:06.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status success for try_number 1 2024-04-03T03:06:06.772567772Z [2024-04-03T03:06:06.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:05:00+00:00, map_index=-1, run_start_date=2024-04-03 03:06:03.330898+00:00, run_end_date=2024-04-03 03:06:06.055551+00:00, run_duration=2.724653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:06:00.507781+00:00, queued_by_job_id=1, pid=7898 2024-04-03T03:06:35.888507723Z [2024-04-03T03:06:35.887+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:07:00.075982622Z [2024-04-03T03:07:00.075+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:07:00.092450948Z [2024-04-03T03:07:00.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:07:00+00:00, run_after=2024-04-03T03:08:00+00:00 2024-04-03T03:07:00.156519528Z [2024-04-03T03:07:00.156+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:07:00.156541149Z 2024-04-03T03:07:00.156546972Z 2024-04-03T03:07:00.156559265Z [2024-04-03T03:07:00.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:07:00.156643952Z [2024-04-03T03:07:00.156+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:07:00.157600014Z [2024-04-03T03:07:00.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:07:00.157612294Z 2024-04-03T03:07:00.157617631Z 2024-04-03T03:07:00.166727040Z [2024-04-03T03:07:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:07:00.171841514Z [2024-04-03T03:07:00.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:07:00.171855775Z [2024-04-03T03:07:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:07:00.171859505Z [2024-04-03T03:07:00.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:07:00.366967621Z [2024-04-03T03:07:00.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:06:00+00:00 exited with status queued for try_number 1 2024-04-03T03:07:00.367183861Z [2024-04-03T03:07:00.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:06:00+00:00 exited with status queued for try_number 1 2024-04-03T03:07:00.373791494Z [2024-04-03T03:07:00.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to b49eec46-a6ae-49e6-95a0-31a75e28ff32 2024-04-03T03:07:00.374002801Z [2024-04-03T03:07:00.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2f526ff-c020-4bc6-bedf-176e4bd25027 2024-04-03T03:07:04.356194262Z [2024-04-03T03:07:04.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:07:04.357094358Z [2024-04-03T03:07:04.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:06:00+00:00, run_id=scheduled__2024-04-03T03:06:00+00:00, run_start_date=2024-04-03 03:07:00.107517+00:00, run_end_date=2024-04-03 03:07:04.356107+00:00, run_duration=4.24859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:06:00+00:00, data_interval_end=2024-04-03 03:07:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:07:04.371511174Z [2024-04-03T03:07:04.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:07:00+00:00, run_after=2024-04-03T03:08:00+00:00 2024-04-03T03:07:04.389363604Z [2024-04-03T03:07:04.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:07:04.389570375Z [2024-04-03T03:07:04.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:06:00+00:00, run_id=scheduled__2024-04-03T03:06:00+00:00, run_start_date=2024-04-03 03:07:00.105988+00:00, run_end_date=2024-04-03 03:07:04.389236+00:00, run_duration=4.283248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:06:00+00:00, data_interval_end=2024-04-03 03:07:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:07:04.399952190Z [2024-04-03T03:07:04.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:07:00+00:00, run_after=2024-04-03T03:08:00+00:00 2024-04-03T03:07:04.437849006Z [2024-04-03T03:07:04.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:06:00+00:00 exited with status success for try_number 1 2024-04-03T03:07:04.438015144Z [2024-04-03T03:07:04.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:06:00+00:00 exited with status success for try_number 1 2024-04-03T03:07:04.445559464Z [2024-04-03T03:07:04.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:06:00+00:00, map_index=-1, run_start_date=2024-04-03 03:07:02.321768+00:00, run_end_date=2024-04-03 03:07:03.941877+00:00, run_duration=1.620109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:07:00.158034+00:00, queued_by_job_id=1, pid=7953 2024-04-03T03:07:04.445902444Z [2024-04-03T03:07:04.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:06:00+00:00, map_index=-1, run_start_date=2024-04-03 03:07:02.190531+00:00, run_end_date=2024-04-03 03:07:03.637876+00:00, run_duration=1.447345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:07:00.158034+00:00, queued_by_job_id=1, pid=7952 2024-04-03T03:08:00.198200968Z [2024-04-03T03:08:00.197+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:08:00.215274031Z [2024-04-03T03:08:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:08:00+00:00, run_after=2024-04-03T03:09:00+00:00 2024-04-03T03:08:00.222834016Z [2024-04-03T03:08:00.221+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:08:00.291759268Z [2024-04-03T03:08:00.291+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:08:00.291779734Z 2024-04-03T03:08:00.291783844Z 2024-04-03T03:08:00.291787323Z 2024-04-03T03:08:00.291853545Z [2024-04-03T03:08:00.291+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:08:00.291968293Z [2024-04-03T03:08:00.291+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:08:00.292094222Z [2024-04-03T03:08:00.291+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:08:00.292835660Z [2024-04-03T03:08:00.292+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:08:00.292844832Z 2024-04-03T03:08:00.292848561Z 2024-04-03T03:08:00.292852296Z 2024-04-03T03:08:00.296482871Z [2024-04-03T03:08:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:08:00.296663158Z [2024-04-03T03:08:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:08:00.296989479Z [2024-04-03T03:08:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:08:00.297121613Z [2024-04-03T03:08:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:08:00.297836204Z [2024-04-03T03:08:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:08:00.297977819Z [2024-04-03T03:08:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:08:00.533340870Z [2024-04-03T03:08:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:06:00+00:00 exited with status queued for try_number 1 2024-04-03T03:08:00.534021956Z [2024-04-03T03:08:00.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:07:00+00:00 exited with status queued for try_number 1 2024-04-03T03:08:00.534219965Z [2024-04-03T03:08:00.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:07:00+00:00 exited with status queued for try_number 1 2024-04-03T03:08:00.546963177Z [2024-04-03T03:08:00.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to adbb1f12-d9cc-4de4-a96f-d9ab9d5c9b3d 2024-04-03T03:08:00.548039470Z [2024-04-03T03:08:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 486363eb-2a28-4b84-b09c-1d5c7a63c234 2024-04-03T03:08:00.548294288Z [2024-04-03T03:08:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 608b3d89-88db-45ae-88a2-7f0bf6392e15 2024-04-03T03:08:02.291569975Z [2024-04-03T03:08:02.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:08:02.291981108Z [2024-04-03T03:08:02.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:06:00+00:00, run_id=scheduled__2024-04-03T03:06:00+00:00, run_start_date=2024-04-03 03:08:00.232957+00:00, run_end_date=2024-04-03 03:08:02.291488+00:00, run_duration=2.058531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:06:00+00:00, data_interval_end=2024-04-03 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:08:02.309441203Z [2024-04-03T03:08:02.309+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:08:00+00:00, run_after=2024-04-03T03:10:00+00:00 2024-04-03T03:08:02.367313644Z [2024-04-03T03:08:02.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:06:00+00:00 exited with status success for try_number 1 2024-04-03T03:08:02.380535095Z [2024-04-03T03:08:02.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:06:00+00:00, map_index=-1, run_start_date=2024-04-03 03:08:01.456865+00:00, run_end_date=2024-04-03 03:08:01.931393+00:00, run_duration=0.474528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:08:00.293535+00:00, queued_by_job_id=1, pid=7987 2024-04-03T03:08:04.613527174Z [2024-04-03T03:08:04.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:08:04.614362562Z [2024-04-03T03:08:04.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:07:00+00:00, run_id=scheduled__2024-04-03T03:07:00+00:00, run_start_date=2024-04-03 03:08:00.235273+00:00, run_end_date=2024-04-03 03:08:04.613327+00:00, run_duration=4.378054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:07:00+00:00, data_interval_end=2024-04-03 03:08:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:08:04.630348274Z [2024-04-03T03:08:04.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:08:00+00:00, run_after=2024-04-03T03:09:00+00:00 2024-04-03T03:08:04.639393937Z [2024-04-03T03:08:04.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:08:04.639902927Z [2024-04-03T03:08:04.639+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:07:00+00:00, run_id=scheduled__2024-04-03T03:07:00+00:00, run_start_date=2024-04-03 03:08:00.234270+00:00, run_end_date=2024-04-03 03:08:04.639245+00:00, run_duration=4.404975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:07:00+00:00, data_interval_end=2024-04-03 03:08:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:08:04.649421307Z [2024-04-03T03:08:04.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:08:00+00:00, run_after=2024-04-03T03:09:00+00:00 2024-04-03T03:08:04.700778540Z [2024-04-03T03:08:04.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:07:00+00:00 exited with status success for try_number 1 2024-04-03T03:08:04.701146979Z [2024-04-03T03:08:04.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:07:00+00:00 exited with status success for try_number 1 2024-04-03T03:08:04.709150790Z [2024-04-03T03:08:04.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:07:00+00:00, map_index=-1, run_start_date=2024-04-03 03:08:02.619277+00:00, run_end_date=2024-04-03 03:08:04.266151+00:00, run_duration=1.646874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:08:00.293535+00:00, queued_by_job_id=1, pid=8008 2024-04-03T03:08:04.709459467Z [2024-04-03T03:08:04.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:07:00+00:00, map_index=-1, run_start_date=2024-04-03 03:08:02.911003+00:00, run_end_date=2024-04-03 03:08:04.249974+00:00, run_duration=1.338971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:08:00.293535+00:00, queued_by_job_id=1, pid=8020 2024-04-03T03:09:00.621099960Z [2024-04-03T03:09:00.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:09:00+00:00, run_after=2024-04-03T03:10:00+00:00 2024-04-03T03:09:00.628677287Z [2024-04-03T03:09:00.628+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:09:00.684426204Z [2024-04-03T03:09:00.684+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:09:00.684451888Z 2024-04-03T03:09:00.684469305Z 2024-04-03T03:09:00.684791781Z [2024-04-03T03:09:00.684+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:09:00.685047483Z [2024-04-03T03:09:00.684+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:09:00.685921150Z [2024-04-03T03:09:00.685+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:09:00.685933446Z 2024-04-03T03:09:00.685937028Z 2024-04-03T03:09:00.689230470Z [2024-04-03T03:09:00.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:09:00.689749582Z [2024-04-03T03:09:00.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:09:00.690200220Z [2024-04-03T03:09:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:09:00.690458441Z [2024-04-03T03:09:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:09:00.945869380Z [2024-04-03T03:09:00.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:08:00+00:00 exited with status queued for try_number 1 2024-04-03T03:09:00.945935067Z [2024-04-03T03:09:00.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:08:00+00:00 exited with status queued for try_number 1 2024-04-03T03:09:00.953201100Z [2024-04-03T03:09:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0f97128-1257-48d1-81aa-835a9ac0bd7d 2024-04-03T03:09:00.953270225Z [2024-04-03T03:09:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a7b1b57-351f-4563-9729-309970629201 2024-04-03T03:09:06.026483981Z [2024-04-03T03:09:06.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:09:06.027062319Z [2024-04-03T03:09:06.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:08:00+00:00, run_id=scheduled__2024-04-03T03:08:00+00:00, run_start_date=2024-04-03 03:09:00.640638+00:00, run_end_date=2024-04-03 03:09:06.026663+00:00, run_duration=5.386025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:08:00+00:00, data_interval_end=2024-04-03 03:09:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:09:06.038841017Z [2024-04-03T03:09:06.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:09:00+00:00, run_after=2024-04-03T03:10:00+00:00 2024-04-03T03:09:06.046330637Z [2024-04-03T03:09:06.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:09:06.046779379Z [2024-04-03T03:09:06.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:08:00+00:00, run_id=scheduled__2024-04-03T03:08:00+00:00, run_start_date=2024-04-03 03:09:00.638391+00:00, run_end_date=2024-04-03 03:09:06.046413+00:00, run_duration=5.408022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:08:00+00:00, data_interval_end=2024-04-03 03:09:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:09:06.057669166Z [2024-04-03T03:09:06.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:09:00+00:00, run_after=2024-04-03T03:10:00+00:00 2024-04-03T03:09:06.094469618Z [2024-04-03T03:09:06.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:08:00+00:00 exited with status success for try_number 1 2024-04-03T03:09:06.094531448Z [2024-04-03T03:09:06.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:08:00+00:00 exited with status success for try_number 1 2024-04-03T03:09:06.105638626Z [2024-04-03T03:09:06.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:08:00+00:00, map_index=-1, run_start_date=2024-04-03 03:09:02.818116+00:00, run_end_date=2024-04-03 03:09:05.607860+00:00, run_duration=2.789744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:09:00.686764+00:00, queued_by_job_id=1, pid=8072 2024-04-03T03:09:06.105836815Z [2024-04-03T03:09:06.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:08:00+00:00, map_index=-1, run_start_date=2024-04-03 03:09:03.022462+00:00, run_end_date=2024-04-03 03:09:04.904933+00:00, run_duration=1.882471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:09:00.686764+00:00, queued_by_job_id=1, pid=8073 2024-04-03T03:10:00.940803892Z [2024-04-03T03:10:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:10:00+00:00, run_after=2024-04-03T03:15:00+00:00 2024-04-03T03:10:00.953154048Z [2024-04-03T03:10:00.952+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:10:00.963817976Z [2024-04-03T03:10:00.962+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:10:00.978930470Z [2024-04-03T03:10:00.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:10:00+00:00, run_after=2024-04-03T03:11:00+00:00 2024-04-03T03:10:01.061146924Z [2024-04-03T03:10:01.060+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T03:10:01.061180866Z 2024-04-03T03:10:01.061184626Z 2024-04-03T03:10:01.061188386Z 2024-04-03T03:10:01.061191929Z 2024-04-03T03:10:01.061201759Z [2024-04-03T03:10:01.061+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:10:01.061261186Z [2024-04-03T03:10:01.061+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:10:01.061348657Z [2024-04-03T03:10:01.061+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:10:01.061414614Z [2024-04-03T03:10:01.061+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:10:01.062001742Z [2024-04-03T03:10:01.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:10:01.062011876Z 2024-04-03T03:10:01.062015799Z 2024-04-03T03:10:01.062019127Z 2024-04-03T03:10:01.062022140Z 2024-04-03T03:10:01.065447004Z [2024-04-03T03:10:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:10:01.065503924Z [2024-04-03T03:10:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:10:01.065745749Z [2024-04-03T03:10:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:10:01.065829008Z [2024-04-03T03:10:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:10:01.066045535Z [2024-04-03T03:10:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:10:01.066151425Z [2024-04-03T03:10:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:10:01.066350891Z [2024-04-03T03:10:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:10:01.066429165Z [2024-04-03T03:10:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:10:01.501441190Z [2024-04-03T03:10:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status queued for try_number 1 2024-04-03T03:10:01.501519850Z [2024-04-03T03:10:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:08:00+00:00 exited with status queued for try_number 1 2024-04-03T03:10:01.501688042Z [2024-04-03T03:10:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:09:00+00:00 exited with status queued for try_number 1 2024-04-03T03:10:01.501777185Z [2024-04-03T03:10:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:09:00+00:00 exited with status queued for try_number 1 2024-04-03T03:10:01.510244495Z [2024-04-03T03:10:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3895bcbe-cf3c-4e9e-bdc1-7b18cc2a92f7 2024-04-03T03:10:01.510509584Z [2024-04-03T03:10:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 553dcd93-6d67-4dcd-aff8-b7dc0b7c0150 2024-04-03T03:10:01.510721912Z [2024-04-03T03:10:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2d75d5f-e93d-40f7-8b89-d147376d5891 2024-04-03T03:10:01.510907508Z [2024-04-03T03:10:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8d7c5d8-670f-4d95-8f05-781c9f8dc0e0 2024-04-03T03:10:02.685970312Z [2024-04-03T03:10:02.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:10:02.686310268Z [2024-04-03T03:10:02.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:08:00+00:00, run_id=scheduled__2024-04-03T03:08:00+00:00, run_start_date=2024-04-03 03:10:00.990541+00:00, run_end_date=2024-04-03 03:10:02.685908+00:00, run_duration=1.695367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:08:00+00:00, data_interval_end=2024-04-03 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:10:02.698803967Z [2024-04-03T03:10:02.698+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:10:00+00:00, run_after=2024-04-03T03:12:00+00:00 2024-04-03T03:10:02.756678841Z [2024-04-03T03:10:02.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:08:00+00:00 exited with status success for try_number 1 2024-04-03T03:10:02.761858584Z [2024-04-03T03:10:02.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:08:00+00:00, map_index=-1, run_start_date=2024-04-03 03:10:01.868387+00:00, run_end_date=2024-04-03 03:10:02.250402+00:00, run_duration=0.382015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:10:01.062844+00:00, queued_by_job_id=1, pid=8109 2024-04-03T03:10:05.313949846Z [2024-04-03T03:10:05.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:10:05.314162931Z [2024-04-03T03:10:05.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:09:00+00:00, run_id=scheduled__2024-04-03T03:09:00+00:00, run_start_date=2024-04-03 03:10:00.991748+00:00, run_end_date=2024-04-03 03:10:05.313894+00:00, run_duration=4.322146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:09:00+00:00, data_interval_end=2024-04-03 03:10:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:10:05.323185103Z [2024-04-03T03:10:05.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:10:00+00:00, run_after=2024-04-03T03:11:00+00:00 2024-04-03T03:10:05.368398514Z [2024-04-03T03:10:05.367+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:10:05.368417445Z 2024-04-03T03:10:05.368856256Z [2024-04-03T03:10:05.368+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:10:05.369848244Z [2024-04-03T03:10:05.369+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:10:05.369852654Z 2024-04-03T03:10:05.373126025Z [2024-04-03T03:10:05.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:10:05.373247753Z [2024-04-03T03:10:05.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:10:05.453045939Z [2024-04-03T03:10:05.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status queued for try_number 1 2024-04-03T03:10:05.453617810Z [2024-04-03T03:10:05.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status success for try_number 1 2024-04-03T03:10:05.453885922Z [2024-04-03T03:10:05.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:09:00+00:00 exited with status success for try_number 1 2024-04-03T03:10:05.466457154Z [2024-04-03T03:10:05.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:05:00+00:00, map_index=-1, run_start_date=2024-04-03 03:10:03.588209+00:00, run_end_date=2024-04-03 03:10:04.058652+00:00, run_duration=0.470443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:10:01.062844+00:00, queued_by_job_id=1, pid=8150 2024-04-03T03:10:05.470074679Z [2024-04-03T03:10:05.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:09:00+00:00, map_index=-1, run_start_date=2024-04-03 03:10:03.731710+00:00, run_end_date=2024-04-03 03:10:05.068040+00:00, run_duration=1.33633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:10:01.062844+00:00, queued_by_job_id=1, pid=8160 2024-04-03T03:10:05.470611522Z [2024-04-03T03:10:05.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17fe5682-fdb9-4b47-bbfb-6946283115b5 2024-04-03T03:10:05.518191702Z [2024-04-03T03:10:05.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:10:05.518441622Z [2024-04-03T03:10:05.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:09:00+00:00, run_id=scheduled__2024-04-03T03:09:00+00:00, run_start_date=2024-04-03 03:10:00.992702+00:00, run_end_date=2024-04-03 03:10:05.518186+00:00, run_duration=4.525484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:09:00+00:00, data_interval_end=2024-04-03 03:10:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:10:05.527308209Z [2024-04-03T03:10:05.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:10:00+00:00, run_after=2024-04-03T03:11:00+00:00 2024-04-03T03:10:05.570022633Z [2024-04-03T03:10:05.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:09:00+00:00 exited with status success for try_number 1 2024-04-03T03:10:05.574893185Z [2024-04-03T03:10:05.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:09:00+00:00, map_index=-1, run_start_date=2024-04-03 03:10:03.306030+00:00, run_end_date=2024-04-03 03:10:05.062250+00:00, run_duration=1.75622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:10:01.062844+00:00, queued_by_job_id=1, pid=8140 2024-04-03T03:10:07.809407014Z [2024-04-03T03:10:07.808+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:10:07.809444961Z 2024-04-03T03:10:07.809649079Z [2024-04-03T03:10:07.809+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:10:07.810558723Z [2024-04-03T03:10:07.810+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:10:07.810564625Z 2024-04-03T03:10:07.813721944Z [2024-04-03T03:10:07.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:10:07.814003214Z [2024-04-03T03:10:07.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:10:07.863395437Z [2024-04-03T03:10:07.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status queued for try_number 1 2024-04-03T03:10:07.863978558Z [2024-04-03T03:10:07.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status success for try_number 1 2024-04-03T03:10:07.870131875Z [2024-04-03T03:10:07.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cb21362-264d-44b3-8225-f1d0b84fff5d 2024-04-03T03:10:07.870428085Z [2024-04-03T03:10:07.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:05:00+00:00, map_index=-1, run_start_date=2024-04-03 03:10:07.097639+00:00, run_end_date=2024-04-03 03:10:07.387323+00:00, run_duration=0.289684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:10:05.371154+00:00, queued_by_job_id=1, pid=8189 2024-04-03T03:10:09.969091562Z [2024-04-03T03:10:09.968+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:10:09.969118302Z 2024-04-03T03:10:09.969332807Z [2024-04-03T03:10:09.969+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:10:09.969951302Z [2024-04-03T03:10:09.969+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:10:09.969958466Z 2024-04-03T03:10:09.972524958Z [2024-04-03T03:10:09.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:10:09.972727635Z [2024-04-03T03:10:09.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:10:10.055795455Z [2024-04-03T03:10:10.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status queued for try_number 1 2024-04-03T03:10:10.055818204Z [2024-04-03T03:10:10.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status success for try_number 1 2024-04-03T03:10:10.069171433Z [2024-04-03T03:10:10.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38b73cc5-c2c6-4f66-98a5-41964cf75118 2024-04-03T03:10:10.070645180Z [2024-04-03T03:10:10.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:05:00+00:00, map_index=0, run_start_date=2024-04-03 03:10:09.415891+00:00, run_end_date=2024-04-03 03:10:09.704777+00:00, run_duration=0.288886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:10:07.811181+00:00, queued_by_job_id=1, pid=8201 2024-04-03T03:10:12.367951680Z [2024-04-03T03:10:12.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:10:12.368262575Z [2024-04-03T03:10:12.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:05:00+00:00, run_id=scheduled__2024-04-03T03:05:00+00:00, run_start_date=2024-04-03 03:10:00.989299+00:00, run_end_date=2024-04-03 03:10:12.367854+00:00, run_duration=11.378555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:05:00+00:00, data_interval_end=2024-04-03 03:10:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:10:12.375601565Z [2024-04-03T03:10:12.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:10:00+00:00, run_after=2024-04-03T03:15:00+00:00 2024-04-03T03:10:12.405185815Z [2024-04-03T03:10:12.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:05:00+00:00 exited with status success for try_number 1 2024-04-03T03:10:12.411849792Z [2024-04-03T03:10:12.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:05:00+00:00, map_index=-1, run_start_date=2024-04-03 03:10:11.817111+00:00, run_end_date=2024-04-03 03:10:12.161082+00:00, run_duration=0.343971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:10:09.970516+00:00, queued_by_job_id=1, pid=8213 2024-04-03T03:11:00.457360447Z [2024-04-03T03:11:00.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:11:00+00:00, run_after=2024-04-03T03:12:00+00:00 2024-04-03T03:11:00.464261614Z [2024-04-03T03:11:00.463+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:11:00.511505319Z [2024-04-03T03:11:00.511+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:11:00.511532761Z 2024-04-03T03:11:00.511536378Z 2024-04-03T03:11:00.511741306Z [2024-04-03T03:11:00.511+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:11:00.511914626Z [2024-04-03T03:11:00.511+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:11:00.512760334Z [2024-04-03T03:11:00.512+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:11:00.512771726Z 2024-04-03T03:11:00.512775210Z 2024-04-03T03:11:00.515502647Z [2024-04-03T03:11:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:11:00.515956618Z [2024-04-03T03:11:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:11:00.516273446Z [2024-04-03T03:11:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:11:00.516566222Z [2024-04-03T03:11:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:11:00.718825956Z [2024-04-03T03:11:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status queued for try_number 1 2024-04-03T03:11:00.719088150Z [2024-04-03T03:11:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status queued for try_number 1 2024-04-03T03:11:00.736458091Z [2024-04-03T03:11:00.736+0000] {scheduler_job.py:635} INFO - Setting external_id for to 327cc659-98f4-41bc-8121-27c65f978f7e 2024-04-03T03:11:00.738127832Z [2024-04-03T03:11:00.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c13c44b-d7d5-4afe-a997-b80988da83c2 2024-04-03T03:11:04.235393324Z [2024-04-03T03:11:04.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:11:04.235909167Z [2024-04-03T03:11:04.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:10:00+00:00, run_id=scheduled__2024-04-03T03:10:00+00:00, run_start_date=2024-04-03 03:11:00.473769+00:00, run_end_date=2024-04-03 03:11:04.235257+00:00, run_duration=3.761488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:10:00+00:00, data_interval_end=2024-04-03 03:11:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:11:04.249186484Z [2024-04-03T03:11:04.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:11:00+00:00, run_after=2024-04-03T03:12:00+00:00 2024-04-03T03:11:04.289408266Z [2024-04-03T03:11:04.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status success for try_number 1 2024-04-03T03:11:04.295116104Z [2024-04-03T03:11:04.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:10:00+00:00, map_index=-1, run_start_date=2024-04-03 03:11:02.636786+00:00, run_end_date=2024-04-03 03:11:03.908469+00:00, run_duration=1.271683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:11:00.513252+00:00, queued_by_job_id=1, pid=8250 2024-04-03T03:11:06.452571636Z [2024-04-03T03:11:06.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:11:06.452895407Z [2024-04-03T03:11:06.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:10:00+00:00, run_id=scheduled__2024-04-03T03:10:00+00:00, run_start_date=2024-04-03 03:11:00.475111+00:00, run_end_date=2024-04-03 03:11:06.452415+00:00, run_duration=5.977304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:10:00+00:00, data_interval_end=2024-04-03 03:11:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:11:06.467169027Z [2024-04-03T03:11:06.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:11:00+00:00, run_after=2024-04-03T03:12:00+00:00 2024-04-03T03:11:06.507609058Z [2024-04-03T03:11:06.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status success for try_number 1 2024-04-03T03:11:06.513461924Z [2024-04-03T03:11:06.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:10:00+00:00, map_index=-1, run_start_date=2024-04-03 03:11:02.490945+00:00, run_end_date=2024-04-03 03:11:05.442007+00:00, run_duration=2.951062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:11:00.513252+00:00, queued_by_job_id=1, pid=8249 2024-04-03T03:11:35.950905156Z [2024-04-03T03:11:35.950+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:12:00.627777903Z [2024-04-03T03:12:00.627+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:12:00.645763759Z [2024-04-03T03:12:00.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:12:00+00:00, run_after=2024-04-03T03:13:00+00:00 2024-04-03T03:12:00.658744066Z [2024-04-03T03:12:00.658+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:12:00.730502653Z [2024-04-03T03:12:00.730+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:12:00.730527365Z 2024-04-03T03:12:00.730531609Z 2024-04-03T03:12:00.730534858Z 2024-04-03T03:12:00.730544599Z [2024-04-03T03:12:00.730+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:12:00.730611576Z [2024-04-03T03:12:00.730+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:12:00.730693175Z [2024-04-03T03:12:00.730+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:12:00.731299464Z [2024-04-03T03:12:00.731+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:12:00.731308032Z 2024-04-03T03:12:00.731311606Z 2024-04-03T03:12:00.731314848Z 2024-04-03T03:12:00.734409700Z [2024-04-03T03:12:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:12:00.734493346Z [2024-04-03T03:12:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:12:00.734689972Z [2024-04-03T03:12:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:12:00.734762583Z [2024-04-03T03:12:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:12:00.734919982Z [2024-04-03T03:12:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:12:00.734983526Z [2024-04-03T03:12:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:12:01.117303892Z [2024-04-03T03:12:01.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status queued for try_number 1 2024-04-03T03:12:01.118993554Z [2024-04-03T03:12:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:11:00+00:00 exited with status queued for try_number 1 2024-04-03T03:12:01.119109269Z [2024-04-03T03:12:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:11:00+00:00 exited with status queued for try_number 1 2024-04-03T03:12:01.135897920Z [2024-04-03T03:12:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6007533f-b3a2-4739-9e34-93dc59066191 2024-04-03T03:12:01.136017025Z [2024-04-03T03:12:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b966afd-1032-4775-bbc0-f582e0e36e1f 2024-04-03T03:12:01.136178970Z [2024-04-03T03:12:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16ec1990-1292-452e-839a-ff59f9d326e5 2024-04-03T03:12:02.376364349Z [2024-04-03T03:12:02.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:12:02.377007154Z [2024-04-03T03:12:02.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:10:00+00:00, run_id=scheduled__2024-04-03T03:10:00+00:00, run_start_date=2024-04-03 03:12:00.672376+00:00, run_end_date=2024-04-03 03:12:02.376623+00:00, run_duration=1.704247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:10:00+00:00, data_interval_end=2024-04-03 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:12:02.385353933Z [2024-04-03T03:12:02.384+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:12:00+00:00, run_after=2024-04-03T03:14:00+00:00 2024-04-03T03:12:02.429830055Z [2024-04-03T03:12:02.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status success for try_number 1 2024-04-03T03:12:02.438303671Z [2024-04-03T03:12:02.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:10:00+00:00, map_index=-1, run_start_date=2024-04-03 03:12:01.731269+00:00, run_end_date=2024-04-03 03:12:02.239398+00:00, run_duration=0.508129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:12:00.732037+00:00, queued_by_job_id=1, pid=8285 2024-04-03T03:12:05.755439247Z [2024-04-03T03:12:05.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:12:05.755814087Z [2024-04-03T03:12:05.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:11:00+00:00, run_id=scheduled__2024-04-03T03:11:00+00:00, run_start_date=2024-04-03 03:12:00.673704+00:00, run_end_date=2024-04-03 03:12:05.755271+00:00, run_duration=5.081567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:11:00+00:00, data_interval_end=2024-04-03 03:12:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:12:05.776228211Z [2024-04-03T03:12:05.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:12:00+00:00, run_after=2024-04-03T03:13:00+00:00 2024-04-03T03:12:05.824956581Z [2024-04-03T03:12:05.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:11:00+00:00 exited with status success for try_number 1 2024-04-03T03:12:05.831207224Z [2024-04-03T03:12:05.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:11:00+00:00, map_index=-1, run_start_date=2024-04-03 03:12:03.309764+00:00, run_end_date=2024-04-03 03:12:04.982154+00:00, run_duration=1.67239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:12:00.732037+00:00, queued_by_job_id=1, pid=8308 2024-04-03T03:12:06.873605485Z [2024-04-03T03:12:06.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:12:06.874361572Z [2024-04-03T03:12:06.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:11:00+00:00, run_id=scheduled__2024-04-03T03:11:00+00:00, run_start_date=2024-04-03 03:12:00.674918+00:00, run_end_date=2024-04-03 03:12:06.873830+00:00, run_duration=6.198912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:11:00+00:00, data_interval_end=2024-04-03 03:12:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:12:06.887866967Z [2024-04-03T03:12:06.887+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:12:00+00:00, run_after=2024-04-03T03:13:00+00:00 2024-04-03T03:12:06.916242752Z [2024-04-03T03:12:06.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:11:00+00:00 exited with status success for try_number 1 2024-04-03T03:12:06.922105720Z [2024-04-03T03:12:06.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:11:00+00:00, map_index=-1, run_start_date=2024-04-03 03:12:03.599654+00:00, run_end_date=2024-04-03 03:12:05.898186+00:00, run_duration=2.298532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:12:00.732037+00:00, queued_by_job_id=1, pid=8316 2024-04-03T03:13:00.463293258Z [2024-04-03T03:13:00.462+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:13:00.477076648Z [2024-04-03T03:13:00.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:13:00+00:00, run_after=2024-04-03T03:14:00+00:00 2024-04-03T03:13:00.531735528Z [2024-04-03T03:13:00.531+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:13:00.531755018Z 2024-04-03T03:13:00.531758858Z 2024-04-03T03:13:00.531794038Z [2024-04-03T03:13:00.531+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:13:00.531897739Z [2024-04-03T03:13:00.531+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:13:00.533039689Z [2024-04-03T03:13:00.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:13:00.533052284Z 2024-04-03T03:13:00.533055730Z 2024-04-03T03:13:00.535765986Z [2024-04-03T03:13:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:13:00.535866480Z [2024-04-03T03:13:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:13:00.536784716Z [2024-04-03T03:13:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:13:00.537225115Z [2024-04-03T03:13:00.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:13:00.879177784Z [2024-04-03T03:13:00.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:12:00+00:00 exited with status queued for try_number 1 2024-04-03T03:13:00.879202844Z [2024-04-03T03:13:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:12:00+00:00 exited with status queued for try_number 1 2024-04-03T03:13:00.892944279Z [2024-04-03T03:13:00.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca0a447b-047c-4982-9e1e-1fff9f9efc83 2024-04-03T03:13:00.894566783Z [2024-04-03T03:13:00.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8d4a3f6-c8ea-4541-8102-4f637145a556 2024-04-03T03:13:05.876335078Z [2024-04-03T03:13:05.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:13:05.876557461Z [2024-04-03T03:13:05.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:12:00+00:00, run_id=scheduled__2024-04-03T03:12:00+00:00, run_start_date=2024-04-03 03:13:00.489414+00:00, run_end_date=2024-04-03 03:13:05.876140+00:00, run_duration=5.386726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:12:00+00:00, data_interval_end=2024-04-03 03:13:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:13:05.887217998Z [2024-04-03T03:13:05.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:13:00+00:00, run_after=2024-04-03T03:14:00+00:00 2024-04-03T03:13:05.896617414Z [2024-04-03T03:13:05.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:13:05.896927908Z [2024-04-03T03:13:05.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:12:00+00:00, run_id=scheduled__2024-04-03T03:12:00+00:00, run_start_date=2024-04-03 03:13:00.488251+00:00, run_end_date=2024-04-03 03:13:05.896619+00:00, run_duration=5.408368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:12:00+00:00, data_interval_end=2024-04-03 03:13:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:13:05.908979068Z [2024-04-03T03:13:05.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:13:00+00:00, run_after=2024-04-03T03:14:00+00:00 2024-04-03T03:13:05.943430487Z [2024-04-03T03:13:05.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:12:00+00:00 exited with status success for try_number 1 2024-04-03T03:13:05.943694558Z [2024-04-03T03:13:05.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:12:00+00:00 exited with status success for try_number 1 2024-04-03T03:13:05.950926453Z [2024-04-03T03:13:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:12:00+00:00, map_index=-1, run_start_date=2024-04-03 03:13:02.701870+00:00, run_end_date=2024-04-03 03:13:05.510560+00:00, run_duration=2.80869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:13:00.533495+00:00, queued_by_job_id=1, pid=8372 2024-04-03T03:13:05.951285942Z [2024-04-03T03:13:05.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:12:00+00:00, map_index=-1, run_start_date=2024-04-03 03:13:02.683838+00:00, run_end_date=2024-04-03 03:13:04.789588+00:00, run_duration=2.10575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:13:00.533495+00:00, queued_by_job_id=1, pid=8371 2024-04-03T03:14:00.877145531Z [2024-04-03T03:14:00.876+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:14:00.885075664Z [2024-04-03T03:14:00.884+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:14:00.898636527Z [2024-04-03T03:14:00.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:14:00+00:00, run_after=2024-04-03T03:15:00+00:00 2024-04-03T03:14:00.964502742Z [2024-04-03T03:14:00.964+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:14:00.964540145Z 2024-04-03T03:14:00.964544807Z 2024-04-03T03:14:00.964548261Z 2024-04-03T03:14:00.964561207Z [2024-04-03T03:14:00.964+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:14:00.964630370Z [2024-04-03T03:14:00.964+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:14:00.964731300Z [2024-04-03T03:14:00.964+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:14:00.965258231Z [2024-04-03T03:14:00.965+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:14:00.965269375Z 2024-04-03T03:14:00.965272865Z 2024-04-03T03:14:00.965276119Z 2024-04-03T03:14:00.968651071Z [2024-04-03T03:14:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:14:00.968753491Z [2024-04-03T03:14:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:14:00.968950716Z [2024-04-03T03:14:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:14:00.969026347Z [2024-04-03T03:14:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:14:00.969205084Z [2024-04-03T03:14:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:14:00.969284049Z [2024-04-03T03:14:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:14:01.306037178Z [2024-04-03T03:14:01.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:12:00+00:00 exited with status queued for try_number 1 2024-04-03T03:14:01.306101444Z [2024-04-03T03:14:01.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:13:00+00:00 exited with status queued for try_number 1 2024-04-03T03:14:01.306241240Z [2024-04-03T03:14:01.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:13:00+00:00 exited with status queued for try_number 1 2024-04-03T03:14:01.317306699Z [2024-04-03T03:14:01.316+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc082a3f-c5ad-406f-8a45-7a584eb15154 2024-04-03T03:14:01.317418642Z [2024-04-03T03:14:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 721de856-b783-43de-a5e6-89277e7a846f 2024-04-03T03:14:01.317555218Z [2024-04-03T03:14:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bf5c098-38c3-4f79-9967-5f024fd9e0ff 2024-04-03T03:14:02.979456862Z [2024-04-03T03:14:02.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:14:02.979666510Z [2024-04-03T03:14:02.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:12:00+00:00, run_id=scheduled__2024-04-03T03:12:00+00:00, run_start_date=2024-04-03 03:14:00.908810+00:00, run_end_date=2024-04-03 03:14:02.979374+00:00, run_duration=2.070564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:12:00+00:00, data_interval_end=2024-04-03 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:14:03.009490460Z [2024-04-03T03:14:03.009+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:14:00+00:00, run_after=2024-04-03T03:16:00+00:00 2024-04-03T03:14:03.106653414Z [2024-04-03T03:14:03.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:12:00+00:00 exited with status success for try_number 1 2024-04-03T03:14:03.118158530Z [2024-04-03T03:14:03.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:12:00+00:00, map_index=-1, run_start_date=2024-04-03 03:14:01.806109+00:00, run_end_date=2024-04-03 03:14:02.162328+00:00, run_duration=0.356219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:14:00.966063+00:00, queued_by_job_id=1, pid=8407 2024-04-03T03:14:06.119381863Z [2024-04-03T03:14:06.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:14:06.119651504Z [2024-04-03T03:14:06.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:13:00+00:00, run_id=scheduled__2024-04-03T03:13:00+00:00, run_start_date=2024-04-03 03:14:00.909968+00:00, run_end_date=2024-04-03 03:14:06.119363+00:00, run_duration=5.209395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:13:00+00:00, data_interval_end=2024-04-03 03:14:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:14:06.127731582Z [2024-04-03T03:14:06.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:14:00+00:00, run_after=2024-04-03T03:15:00+00:00 2024-04-03T03:14:06.165776485Z [2024-04-03T03:14:06.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:13:00+00:00 exited with status success for try_number 1 2024-04-03T03:14:06.170732835Z [2024-04-03T03:14:06.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:13:00+00:00, map_index=-1, run_start_date=2024-04-03 03:14:03.092405+00:00, run_end_date=2024-04-03 03:14:05.559884+00:00, run_duration=2.467479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:14:00.966063+00:00, queued_by_job_id=1, pid=8437 2024-04-03T03:14:08.024365397Z [2024-04-03T03:14:08.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:14:08.024664218Z [2024-04-03T03:14:08.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:13:00+00:00, run_id=scheduled__2024-04-03T03:13:00+00:00, run_start_date=2024-04-03 03:14:00.911105+00:00, run_end_date=2024-04-03 03:14:08.024260+00:00, run_duration=7.113155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:13:00+00:00, data_interval_end=2024-04-03 03:14:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:14:08.032404801Z [2024-04-03T03:14:08.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:14:00+00:00, run_after=2024-04-03T03:15:00+00:00 2024-04-03T03:14:08.060914731Z [2024-04-03T03:14:08.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:13:00+00:00 exited with status success for try_number 1 2024-04-03T03:14:08.066365857Z [2024-04-03T03:14:08.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:13:00+00:00, map_index=-1, run_start_date=2024-04-03 03:14:03.148309+00:00, run_end_date=2024-04-03 03:14:07.678414+00:00, run_duration=4.530105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:14:00.966063+00:00, queued_by_job_id=1, pid=8438 2024-04-03T03:15:00.802724543Z [2024-04-03T03:15:00.795+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:15:00+00:00, run_after=2024-04-03T03:16:00+00:00 2024-04-03T03:15:00.812712577Z [2024-04-03T03:15:00.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:15:00+00:00, run_after=2024-04-03T03:20:00+00:00 2024-04-03T03:15:00.825230849Z [2024-04-03T03:15:00.824+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:15:00.891076850Z [2024-04-03T03:15:00.890+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:15:00.891092866Z 2024-04-03T03:15:00.891103894Z 2024-04-03T03:15:00.891107369Z 2024-04-03T03:15:00.891243235Z [2024-04-03T03:15:00.891+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:15:00.891480366Z [2024-04-03T03:15:00.891+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:15:00.891625694Z [2024-04-03T03:15:00.891+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:15:00.892253261Z [2024-04-03T03:15:00.892+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:15:00.892264682Z 2024-04-03T03:15:00.892268174Z 2024-04-03T03:15:00.892271436Z 2024-04-03T03:15:00.895372185Z [2024-04-03T03:15:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:15:00.895567857Z [2024-04-03T03:15:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:15:00.895833836Z [2024-04-03T03:15:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:15:00.895953902Z [2024-04-03T03:15:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:15:00.896152854Z [2024-04-03T03:15:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:15:00.896270701Z [2024-04-03T03:15:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:15:01.122560597Z [2024-04-03T03:15:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status queued for try_number 1 2024-04-03T03:15:01.124494386Z [2024-04-03T03:15:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:14:00+00:00 exited with status queued for try_number 1 2024-04-03T03:15:01.124705615Z [2024-04-03T03:15:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:14:00+00:00 exited with status queued for try_number 1 2024-04-03T03:15:01.133427050Z [2024-04-03T03:15:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to e254660f-ac0d-4b51-be07-4c4f51f67afc 2024-04-03T03:15:01.133743684Z [2024-04-03T03:15:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61d4d5a3-95b1-4d4a-8e65-0c5be1da0c74 2024-04-03T03:15:01.134075820Z [2024-04-03T03:15:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb4251b2-24a2-462c-a13a-fa48b7efc4cb 2024-04-03T03:15:03.872128546Z [2024-04-03T03:15:03.871+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:15:03.872182348Z 2024-04-03T03:15:03.872342258Z [2024-04-03T03:15:03.872+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:15:03.873122426Z [2024-04-03T03:15:03.872+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:15:03.873136339Z 2024-04-03T03:15:03.876035222Z [2024-04-03T03:15:03.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:15:03.876199972Z [2024-04-03T03:15:03.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:15:03.944157672Z [2024-04-03T03:15:03.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status queued for try_number 1 2024-04-03T03:15:03.944768869Z [2024-04-03T03:15:03.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status success for try_number 1 2024-04-03T03:15:03.954125082Z [2024-04-03T03:15:03.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5cea178-2df6-4b1d-8518-65d035b000b1 2024-04-03T03:15:03.954390510Z [2024-04-03T03:15:03.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:10:00+00:00, map_index=-1, run_start_date=2024-04-03 03:15:02.920460+00:00, run_end_date=2024-04-03 03:15:03.322996+00:00, run_duration=0.402536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:15:00.892926+00:00, queued_by_job_id=1, pid=8503 2024-04-03T03:15:05.162303338Z [2024-04-03T03:15:05.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:15:05.162902441Z [2024-04-03T03:15:05.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:14:00+00:00, run_id=scheduled__2024-04-03T03:14:00+00:00, run_start_date=2024-04-03 03:15:00.839073+00:00, run_end_date=2024-04-03 03:15:05.162213+00:00, run_duration=4.32314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:14:00+00:00, data_interval_end=2024-04-03 03:15:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:15:05.174180153Z [2024-04-03T03:15:05.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:15:00+00:00, run_after=2024-04-03T03:16:00+00:00 2024-04-03T03:15:05.181212982Z [2024-04-03T03:15:05.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:15:05.182003570Z [2024-04-03T03:15:05.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:14:00+00:00, run_id=scheduled__2024-04-03T03:14:00+00:00, run_start_date=2024-04-03 03:15:00.837963+00:00, run_end_date=2024-04-03 03:15:05.181107+00:00, run_duration=4.343144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:14:00+00:00, data_interval_end=2024-04-03 03:15:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:15:05.196961585Z [2024-04-03T03:15:05.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:15:00+00:00, run_after=2024-04-03T03:16:00+00:00 2024-04-03T03:15:05.256085135Z [2024-04-03T03:15:05.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:14:00+00:00 exited with status success for try_number 1 2024-04-03T03:15:05.256239573Z [2024-04-03T03:15:05.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:14:00+00:00 exited with status success for try_number 1 2024-04-03T03:15:05.262067591Z [2024-04-03T03:15:05.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:14:00+00:00, map_index=-1, run_start_date=2024-04-03 03:15:02.923508+00:00, run_end_date=2024-04-03 03:15:04.823252+00:00, run_duration=1.899744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:15:00.892926+00:00, queued_by_job_id=1, pid=8504 2024-04-03T03:15:05.262279886Z [2024-04-03T03:15:05.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:14:00+00:00, map_index=-1, run_start_date=2024-04-03 03:15:03.183914+00:00, run_end_date=2024-04-03 03:15:04.549216+00:00, run_duration=1.365302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:15:00.892926+00:00, queued_by_job_id=1, pid=8518 2024-04-03T03:15:06.447857038Z [2024-04-03T03:15:06.447+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:15:06.447889374Z 2024-04-03T03:15:06.447905490Z [2024-04-03T03:15:06.447+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:15:06.448485752Z [2024-04-03T03:15:06.448+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:15:06.448507028Z 2024-04-03T03:15:06.451237667Z [2024-04-03T03:15:06.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:15:06.451376128Z [2024-04-03T03:15:06.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:15:06.514468591Z [2024-04-03T03:15:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status queued for try_number 1 2024-04-03T03:15:06.515022269Z [2024-04-03T03:15:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status success for try_number 1 2024-04-03T03:15:06.525273301Z [2024-04-03T03:15:06.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to f554b0c0-6a9e-4b96-8504-16308a105544 2024-04-03T03:15:06.525575579Z [2024-04-03T03:15:06.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:10:00+00:00, map_index=-1, run_start_date=2024-04-03 03:15:05.497875+00:00, run_end_date=2024-04-03 03:15:05.781465+00:00, run_duration=0.28359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:15:03.873578+00:00, queued_by_job_id=1, pid=8544 2024-04-03T03:15:08.933948227Z [2024-04-03T03:15:08.933+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:15:08.933986538Z 2024-04-03T03:15:08.934292024Z [2024-04-03T03:15:08.933+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:15:08.935756682Z [2024-04-03T03:15:08.935+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:15:08.935779389Z 2024-04-03T03:15:08.938972753Z [2024-04-03T03:15:08.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:15:08.939275915Z [2024-04-03T03:15:08.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:15:09.039405413Z [2024-04-03T03:15:09.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status queued for try_number 1 2024-04-03T03:15:09.040140534Z [2024-04-03T03:15:09.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status success for try_number 1 2024-04-03T03:15:09.050733389Z [2024-04-03T03:15:09.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28bcd8a6-4ea3-4f2e-b0dd-a0653561237a 2024-04-03T03:15:09.050989801Z [2024-04-03T03:15:09.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:10:00+00:00, map_index=0, run_start_date=2024-04-03 03:15:08.105751+00:00, run_end_date=2024-04-03 03:15:08.400939+00:00, run_duration=0.295188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:15:06.448824+00:00, queued_by_job_id=1, pid=8556 2024-04-03T03:15:11.289097944Z [2024-04-03T03:15:11.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:15:11.289127938Z [2024-04-03T03:15:11.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:10:00+00:00, run_id=scheduled__2024-04-03T03:10:00+00:00, run_start_date=2024-04-03 03:15:00.836746+00:00, run_end_date=2024-04-03 03:15:11.287873+00:00, run_duration=10.451127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:10:00+00:00, data_interval_end=2024-04-03 03:15:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:15:11.302269081Z [2024-04-03T03:15:11.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:15:00+00:00, run_after=2024-04-03T03:20:00+00:00 2024-04-03T03:15:11.329207803Z [2024-04-03T03:15:11.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:10:00+00:00 exited with status success for try_number 1 2024-04-03T03:15:11.333461164Z [2024-04-03T03:15:11.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:10:00+00:00, map_index=-1, run_start_date=2024-04-03 03:15:10.904025+00:00, run_end_date=2024-04-03 03:15:11.195132+00:00, run_duration=0.291107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:15:08.936377+00:00, queued_by_job_id=1, pid=8568 2024-04-03T03:16:00.636683325Z [2024-04-03T03:16:00.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:16:00+00:00, run_after=2024-04-03T03:17:00+00:00 2024-04-03T03:16:00.652893010Z [2024-04-03T03:16:00.652+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:16:00.662828971Z [2024-04-03T03:16:00.662+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:16:00.733725502Z [2024-04-03T03:16:00.733+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:16:00.733751953Z 2024-04-03T03:16:00.733758283Z 2024-04-03T03:16:00.733762932Z 2024-04-03T03:16:00.733882919Z [2024-04-03T03:16:00.733+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:16:00.733889788Z [2024-04-03T03:16:00.733+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:16:00.733941365Z [2024-04-03T03:16:00.733+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:16:00.734677240Z [2024-04-03T03:16:00.734+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:16:00.734688595Z 2024-04-03T03:16:00.734692068Z 2024-04-03T03:16:00.734695134Z 2024-04-03T03:16:00.737895452Z [2024-04-03T03:16:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:16:00.738026756Z [2024-04-03T03:16:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:16:00.738221826Z [2024-04-03T03:16:00.738+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:16:00.738322487Z [2024-04-03T03:16:00.738+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:16:00.738487243Z [2024-04-03T03:16:00.738+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:16:00.738578090Z [2024-04-03T03:16:00.738+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:16:01.130097515Z [2024-04-03T03:16:01.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:14:00+00:00 exited with status queued for try_number 1 2024-04-03T03:16:01.130282398Z [2024-04-03T03:16:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status queued for try_number 1 2024-04-03T03:16:01.130438030Z [2024-04-03T03:16:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status queued for try_number 1 2024-04-03T03:16:01.144103385Z [2024-04-03T03:16:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c019073-10d2-4832-b4fc-72d9e76a4315 2024-04-03T03:16:01.144458755Z [2024-04-03T03:16:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29027bc6-e27f-4c9e-ba2b-e39e057c2ca7 2024-04-03T03:16:01.144805737Z [2024-04-03T03:16:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 387ece8d-4593-4e9d-bf59-c810f713268d 2024-04-03T03:16:02.367704944Z [2024-04-03T03:16:02.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:16:02.368218708Z [2024-04-03T03:16:02.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:14:00+00:00, run_id=scheduled__2024-04-03T03:14:00+00:00, run_start_date=2024-04-03 03:16:00.676981+00:00, run_end_date=2024-04-03 03:16:02.367779+00:00, run_duration=1.690798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:14:00+00:00, data_interval_end=2024-04-03 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:16:02.375795356Z [2024-04-03T03:16:02.375+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:16:00+00:00, run_after=2024-04-03T03:18:00+00:00 2024-04-03T03:16:02.425403961Z [2024-04-03T03:16:02.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:14:00+00:00 exited with status success for try_number 1 2024-04-03T03:16:02.433057987Z [2024-04-03T03:16:02.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:14:00+00:00, map_index=-1, run_start_date=2024-04-03 03:16:01.676856+00:00, run_end_date=2024-04-03 03:16:02.113418+00:00, run_duration=0.436562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:16:00.735365+00:00, queued_by_job_id=1, pid=8585 2024-04-03T03:16:06.649692684Z [2024-04-03T03:16:06.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:16:06.649752268Z [2024-04-03T03:16:06.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:15:00+00:00, run_id=scheduled__2024-04-03T03:15:00+00:00, run_start_date=2024-04-03 03:16:00.678173+00:00, run_end_date=2024-04-03 03:16:06.648320+00:00, run_duration=5.970147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:15:00+00:00, data_interval_end=2024-04-03 03:16:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:16:06.668750132Z [2024-04-03T03:16:06.665+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:16:00+00:00, run_after=2024-04-03T03:17:00+00:00 2024-04-03T03:16:06.678767664Z [2024-04-03T03:16:06.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:16:06.678959375Z [2024-04-03T03:16:06.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:15:00+00:00, run_id=scheduled__2024-04-03T03:15:00+00:00, run_start_date=2024-04-03 03:16:00.679591+00:00, run_end_date=2024-04-03 03:16:06.678699+00:00, run_duration=5.999108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:15:00+00:00, data_interval_end=2024-04-03 03:16:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:16:06.690784230Z [2024-04-03T03:16:06.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:16:00+00:00, run_after=2024-04-03T03:17:00+00:00 2024-04-03T03:16:06.724953866Z [2024-04-03T03:16:06.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status success for try_number 1 2024-04-03T03:16:06.725369762Z [2024-04-03T03:16:06.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status success for try_number 1 2024-04-03T03:16:06.735562597Z [2024-04-03T03:16:06.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:15:00+00:00, map_index=-1, run_start_date=2024-04-03 03:16:03.348435+00:00, run_end_date=2024-04-03 03:16:05.568019+00:00, run_duration=2.219584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:16:00.735365+00:00, queued_by_job_id=1, pid=8616 2024-04-03T03:16:06.736060764Z [2024-04-03T03:16:06.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:15:00+00:00, map_index=-1, run_start_date=2024-04-03 03:16:03.164569+00:00, run_end_date=2024-04-03 03:16:05.904520+00:00, run_duration=2.739951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:16:00.735365+00:00, queued_by_job_id=1, pid=8615 2024-04-03T03:16:36.016638097Z [2024-04-03T03:16:36.016+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:17:00.443934981Z [2024-04-03T03:17:00.443+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:17:00.458021683Z [2024-04-03T03:17:00.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:17:00+00:00, run_after=2024-04-03T03:18:00+00:00 2024-04-03T03:17:00.524482626Z [2024-04-03T03:17:00.524+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:17:00.524514249Z 2024-04-03T03:17:00.524519057Z 2024-04-03T03:17:00.524759704Z [2024-04-03T03:17:00.524+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:17:00.525109284Z [2024-04-03T03:17:00.524+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:17:00.526149278Z [2024-04-03T03:17:00.525+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:17:00.526163608Z 2024-04-03T03:17:00.526168264Z 2024-04-03T03:17:00.529480180Z [2024-04-03T03:17:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:17:00.529736163Z [2024-04-03T03:17:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:17:00.530105460Z [2024-04-03T03:17:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:17:00.530293479Z [2024-04-03T03:17:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:17:00.891871480Z [2024-04-03T03:17:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:16:00+00:00 exited with status queued for try_number 1 2024-04-03T03:17:00.891917413Z [2024-04-03T03:17:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:16:00+00:00 exited with status queued for try_number 1 2024-04-03T03:17:00.904980051Z [2024-04-03T03:17:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2826567-3882-4d1a-97dd-c7e077b38c7d 2024-04-03T03:17:00.906135931Z [2024-04-03T03:17:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 882a0f10-1d2c-4aac-96d7-fb5fe958b9ed 2024-04-03T03:17:05.565538495Z [2024-04-03T03:17:05.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:17:05.566036785Z [2024-04-03T03:17:05.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:16:00+00:00, run_id=scheduled__2024-04-03T03:16:00+00:00, run_start_date=2024-04-03 03:17:00.475827+00:00, run_end_date=2024-04-03 03:17:05.565417+00:00, run_duration=5.08959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:16:00+00:00, data_interval_end=2024-04-03 03:17:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:17:05.583468117Z [2024-04-03T03:17:05.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:17:00+00:00, run_after=2024-04-03T03:18:00+00:00 2024-04-03T03:17:05.593821384Z [2024-04-03T03:17:05.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:17:05.594526759Z [2024-04-03T03:17:05.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:16:00+00:00, run_id=scheduled__2024-04-03T03:16:00+00:00, run_start_date=2024-04-03 03:17:00.477909+00:00, run_end_date=2024-04-03 03:17:05.594013+00:00, run_duration=5.116104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:16:00+00:00, data_interval_end=2024-04-03 03:17:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:17:05.610440571Z [2024-04-03T03:17:05.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:17:00+00:00, run_after=2024-04-03T03:18:00+00:00 2024-04-03T03:17:05.651092713Z [2024-04-03T03:17:05.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:16:00+00:00 exited with status success for try_number 1 2024-04-03T03:17:05.651475179Z [2024-04-03T03:17:05.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:16:00+00:00 exited with status success for try_number 1 2024-04-03T03:17:05.658860088Z [2024-04-03T03:17:05.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:16:00+00:00, map_index=-1, run_start_date=2024-04-03 03:17:02.729906+00:00, run_end_date=2024-04-03 03:17:04.631387+00:00, run_duration=1.901481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:17:00.527089+00:00, queued_by_job_id=1, pid=8670 2024-04-03T03:17:05.659133485Z [2024-04-03T03:17:05.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:16:00+00:00, map_index=-1, run_start_date=2024-04-03 03:17:02.754881+00:00, run_end_date=2024-04-03 03:17:04.563704+00:00, run_duration=1.808823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:17:00.527089+00:00, queued_by_job_id=1, pid=8671 2024-04-03T03:18:00.238205458Z [2024-04-03T03:18:00.237+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:18:00.255358298Z [2024-04-03T03:18:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:18:00+00:00, run_after=2024-04-03T03:19:00+00:00 2024-04-03T03:18:00.264691069Z [2024-04-03T03:18:00.264+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:18:00.320536316Z [2024-04-03T03:18:00.320+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:18:00.320572246Z 2024-04-03T03:18:00.320576261Z 2024-04-03T03:18:00.320579642Z 2024-04-03T03:18:00.320677779Z [2024-04-03T03:18:00.320+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:18:00.320918971Z [2024-04-03T03:18:00.320+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:18:00.321226704Z [2024-04-03T03:18:00.321+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:18:00.321828331Z [2024-04-03T03:18:00.321+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:18:00.321839680Z 2024-04-03T03:18:00.321843425Z 2024-04-03T03:18:00.321846492Z 2024-04-03T03:18:00.324925126Z [2024-04-03T03:18:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:18:00.325957718Z [2024-04-03T03:18:00.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:18:00.326276096Z [2024-04-03T03:18:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:18:00.326504564Z [2024-04-03T03:18:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:18:00.326916617Z [2024-04-03T03:18:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:18:00.327122243Z [2024-04-03T03:18:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:18:00.618808555Z [2024-04-03T03:18:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:16:00+00:00 exited with status queued for try_number 1 2024-04-03T03:18:00.619029359Z [2024-04-03T03:18:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:17:00+00:00 exited with status queued for try_number 1 2024-04-03T03:18:00.619194436Z [2024-04-03T03:18:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:17:00+00:00 exited with status queued for try_number 1 2024-04-03T03:18:00.627075384Z [2024-04-03T03:18:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26b44d4c-24b1-490d-9e61-a29434a82369 2024-04-03T03:18:00.627362638Z [2024-04-03T03:18:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff5dac13-142b-418e-aab4-aa7096cf39ec 2024-04-03T03:18:00.627617506Z [2024-04-03T03:18:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2bbff53-c928-4c86-bb94-8de7f03c1620 2024-04-03T03:18:02.966834760Z [2024-04-03T03:18:02.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:18:02.967058233Z [2024-04-03T03:18:02.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:16:00+00:00, run_id=scheduled__2024-04-03T03:16:00+00:00, run_start_date=2024-04-03 03:18:00.274356+00:00, run_end_date=2024-04-03 03:18:02.966748+00:00, run_duration=2.692392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:16:00+00:00, data_interval_end=2024-04-03 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:18:02.974418139Z [2024-04-03T03:18:02.974+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:18:00+00:00, run_after=2024-04-03T03:20:00+00:00 2024-04-03T03:18:03.036433068Z [2024-04-03T03:18:03.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:16:00+00:00 exited with status success for try_number 1 2024-04-03T03:18:03.048161935Z [2024-04-03T03:18:03.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:16:00+00:00, map_index=-1, run_start_date=2024-04-03 03:18:01.803848+00:00, run_end_date=2024-04-03 03:18:02.197318+00:00, run_duration=0.39347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:18:00.322534+00:00, queued_by_job_id=1, pid=8707 2024-04-03T03:18:04.578268925Z [2024-04-03T03:18:04.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:18:04.578769556Z [2024-04-03T03:18:04.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:17:00+00:00, run_id=scheduled__2024-04-03T03:17:00+00:00, run_start_date=2024-04-03 03:18:00.275625+00:00, run_end_date=2024-04-03 03:18:04.578336+00:00, run_duration=4.302711, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:17:00+00:00, data_interval_end=2024-04-03 03:18:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:18:04.590793051Z [2024-04-03T03:18:04.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:18:00+00:00, run_after=2024-04-03T03:19:00+00:00 2024-04-03T03:18:04.600792985Z [2024-04-03T03:18:04.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:18:04.601228844Z [2024-04-03T03:18:04.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:17:00+00:00, run_id=scheduled__2024-04-03T03:17:00+00:00, run_start_date=2024-04-03 03:18:00.276575+00:00, run_end_date=2024-04-03 03:18:04.600834+00:00, run_duration=4.324259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:17:00+00:00, data_interval_end=2024-04-03 03:18:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:18:04.611165397Z [2024-04-03T03:18:04.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:18:00+00:00, run_after=2024-04-03T03:19:00+00:00 2024-04-03T03:18:04.653055764Z [2024-04-03T03:18:04.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:17:00+00:00 exited with status success for try_number 1 2024-04-03T03:18:04.653163419Z [2024-04-03T03:18:04.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:17:00+00:00 exited with status success for try_number 1 2024-04-03T03:18:04.661750809Z [2024-04-03T03:18:04.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:17:00+00:00, map_index=-1, run_start_date=2024-04-03 03:18:02.676222+00:00, run_end_date=2024-04-03 03:18:03.980001+00:00, run_duration=1.303779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:18:00.322534+00:00, queued_by_job_id=1, pid=8737 2024-04-03T03:18:04.662069322Z [2024-04-03T03:18:04.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:17:00+00:00, map_index=-1, run_start_date=2024-04-03 03:18:02.478156+00:00, run_end_date=2024-04-03 03:18:04.058529+00:00, run_duration=1.580373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:18:00.322534+00:00, queued_by_job_id=1, pid=8731 2024-04-03T03:19:00.542626829Z [2024-04-03T03:19:00.542+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:19:00.564063195Z [2024-04-03T03:19:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:19:00+00:00, run_after=2024-04-03T03:20:00+00:00 2024-04-03T03:19:00.650465482Z [2024-04-03T03:19:00.650+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:19:00.650493488Z 2024-04-03T03:19:00.650510475Z 2024-04-03T03:19:00.650579117Z [2024-04-03T03:19:00.650+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:19:00.650631976Z [2024-04-03T03:19:00.650+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:19:00.651557332Z [2024-04-03T03:19:00.651+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:19:00.651566671Z 2024-04-03T03:19:00.651570018Z 2024-04-03T03:19:00.655382025Z [2024-04-03T03:19:00.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:19:00.655522689Z [2024-04-03T03:19:00.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:19:00.655776880Z [2024-04-03T03:19:00.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:19:00.655878322Z [2024-04-03T03:19:00.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:19:00.954965502Z [2024-04-03T03:19:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:18:00+00:00 exited with status queued for try_number 1 2024-04-03T03:19:00.955069462Z [2024-04-03T03:19:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:18:00+00:00 exited with status queued for try_number 1 2024-04-03T03:19:00.972458942Z [2024-04-03T03:19:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85a33bed-612a-480d-ab5b-e0c57a48c16e 2024-04-03T03:19:00.972558912Z [2024-04-03T03:19:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f421772-7b93-4107-bb11-94634edd0d34 2024-04-03T03:19:05.080868846Z [2024-04-03T03:19:05.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:19:05.081133104Z [2024-04-03T03:19:05.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:18:00+00:00, run_id=scheduled__2024-04-03T03:18:00+00:00, run_start_date=2024-04-03 03:19:00.576517+00:00, run_end_date=2024-04-03 03:19:05.080762+00:00, run_duration=4.504245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:18:00+00:00, data_interval_end=2024-04-03 03:19:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:19:05.090450012Z [2024-04-03T03:19:05.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:19:00+00:00, run_after=2024-04-03T03:20:00+00:00 2024-04-03T03:19:05.136507350Z [2024-04-03T03:19:05.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:18:00+00:00 exited with status success for try_number 1 2024-04-03T03:19:05.142266670Z [2024-04-03T03:19:05.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:18:00+00:00, map_index=-1, run_start_date=2024-04-03 03:19:02.653292+00:00, run_end_date=2024-04-03 03:19:04.351534+00:00, run_duration=1.698242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:19:00.652342+00:00, queued_by_job_id=1, pid=8791 2024-04-03T03:19:06.190211319Z [2024-04-03T03:19:06.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:19:06.190427520Z [2024-04-03T03:19:06.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:18:00+00:00, run_id=scheduled__2024-04-03T03:18:00+00:00, run_start_date=2024-04-03 03:19:00.578330+00:00, run_end_date=2024-04-03 03:19:06.190119+00:00, run_duration=5.611789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:18:00+00:00, data_interval_end=2024-04-03 03:19:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:19:06.199728259Z [2024-04-03T03:19:06.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:19:00+00:00, run_after=2024-04-03T03:20:00+00:00 2024-04-03T03:19:06.233701252Z [2024-04-03T03:19:06.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:18:00+00:00 exited with status success for try_number 1 2024-04-03T03:19:06.238739227Z [2024-04-03T03:19:06.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:18:00+00:00, map_index=-1, run_start_date=2024-04-03 03:19:02.741626+00:00, run_end_date=2024-04-03 03:19:05.452533+00:00, run_duration=2.710907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:19:00.652342+00:00, queued_by_job_id=1, pid=8792 2024-04-03T03:20:00.405690166Z [2024-04-03T03:20:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:20:00+00:00, run_after=2024-04-03T03:25:00+00:00 2024-04-03T03:20:00.417473136Z [2024-04-03T03:20:00.417+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:20:00.426645750Z [2024-04-03T03:20:00.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:20:00.439540306Z [2024-04-03T03:20:00.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:20:00+00:00, run_after=2024-04-03T03:21:00+00:00 2024-04-03T03:20:00.527277688Z [2024-04-03T03:20:00.526+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T03:20:00.527325146Z 2024-04-03T03:20:00.527328771Z 2024-04-03T03:20:00.527332715Z 2024-04-03T03:20:00.527336020Z 2024-04-03T03:20:00.527396205Z [2024-04-03T03:20:00.527+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:20:00.527401254Z [2024-04-03T03:20:00.527+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:20:00.527499028Z [2024-04-03T03:20:00.527+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:20:00.527568551Z [2024-04-03T03:20:00.527+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:20:00.530147771Z [2024-04-03T03:20:00.529+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:20:00.530163707Z 2024-04-03T03:20:00.530168265Z 2024-04-03T03:20:00.530172032Z 2024-04-03T03:20:00.530181679Z 2024-04-03T03:20:00.534824389Z [2024-04-03T03:20:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:20:00.534945161Z [2024-04-03T03:20:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:20:00.535194510Z [2024-04-03T03:20:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:20:00.535294389Z [2024-04-03T03:20:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:20:00.535531172Z [2024-04-03T03:20:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:20:00.535644127Z [2024-04-03T03:20:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:20:00.535826266Z [2024-04-03T03:20:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:20:00.535925089Z [2024-04-03T03:20:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:20:01.007688017Z [2024-04-03T03:20:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status queued for try_number 1 2024-04-03T03:20:01.008445250Z [2024-04-03T03:20:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:18:00+00:00 exited with status queued for try_number 1 2024-04-03T03:20:01.008813966Z [2024-04-03T03:20:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:19:00+00:00 exited with status queued for try_number 1 2024-04-03T03:20:01.009852704Z [2024-04-03T03:20:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:19:00+00:00 exited with status queued for try_number 1 2024-04-03T03:20:01.036257721Z [2024-04-03T03:20:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9da365a2-6ead-45ac-9253-3756d11a277b 2024-04-03T03:20:01.037043114Z [2024-04-03T03:20:01.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to 926e35a8-3708-4bbd-b28a-8294a26eb2ab 2024-04-03T03:20:01.037320801Z [2024-04-03T03:20:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bb0b8c6-6b68-4017-8b9d-45b4231b83a3 2024-04-03T03:20:01.037853757Z [2024-04-03T03:20:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1e755eb-ec61-4179-baa8-6907bdc907f2 2024-04-03T03:20:03.456199074Z [2024-04-03T03:20:03.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:20:03.456470409Z [2024-04-03T03:20:03.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:18:00+00:00, run_id=scheduled__2024-04-03T03:18:00+00:00, run_start_date=2024-04-03 03:20:00.456938+00:00, run_end_date=2024-04-03 03:20:03.456100+00:00, run_duration=2.999162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:18:00+00:00, data_interval_end=2024-04-03 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:20:03.472499243Z [2024-04-03T03:20:03.470+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:20:00+00:00, run_after=2024-04-03T03:22:00+00:00 2024-04-03T03:20:03.602897832Z [2024-04-03T03:20:03.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:18:00+00:00 exited with status success for try_number 1 2024-04-03T03:20:03.616077351Z [2024-04-03T03:20:03.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:18:00+00:00, map_index=-1, run_start_date=2024-04-03 03:20:01.504520+00:00, run_end_date=2024-04-03 03:20:02.277679+00:00, run_duration=0.773159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:20:00.531069+00:00, queued_by_job_id=1, pid=8828 2024-04-03T03:20:04.513535092Z [2024-04-03T03:20:04.512+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:20:04.513717790Z 2024-04-03T03:20:04.513725674Z [2024-04-03T03:20:04.513+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:20:04.514137739Z [2024-04-03T03:20:04.513+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:20:04.514160668Z 2024-04-03T03:20:04.517367877Z [2024-04-03T03:20:04.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:20:04.517593140Z [2024-04-03T03:20:04.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:20:04.599465035Z [2024-04-03T03:20:04.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status queued for try_number 1 2024-04-03T03:20:04.599513891Z [2024-04-03T03:20:04.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status success for try_number 1 2024-04-03T03:20:04.608674700Z [2024-04-03T03:20:04.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd5b51c1-423e-434d-8a91-1af9e0d95890 2024-04-03T03:20:04.608783584Z [2024-04-03T03:20:04.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:15:00+00:00, map_index=-1, run_start_date=2024-04-03 03:20:03.626220+00:00, run_end_date=2024-04-03 03:20:04.203595+00:00, run_duration=0.577375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:20:00.531069+00:00, queued_by_job_id=1, pid=8864 2024-04-03T03:20:05.777677896Z [2024-04-03T03:20:05.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:20:05.778779321Z [2024-04-03T03:20:05.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:19:00+00:00, run_id=scheduled__2024-04-03T03:19:00+00:00, run_start_date=2024-04-03 03:20:00.459075+00:00, run_end_date=2024-04-03 03:20:05.777979+00:00, run_duration=5.318904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:19:00+00:00, data_interval_end=2024-04-03 03:20:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:20:05.794125509Z [2024-04-03T03:20:05.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:20:00+00:00, run_after=2024-04-03T03:21:00+00:00 2024-04-03T03:20:05.802899099Z [2024-04-03T03:20:05.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:20:05.803182141Z [2024-04-03T03:20:05.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:19:00+00:00, run_id=scheduled__2024-04-03T03:19:00+00:00, run_start_date=2024-04-03 03:20:00.457966+00:00, run_end_date=2024-04-03 03:20:05.802787+00:00, run_duration=5.344821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:19:00+00:00, data_interval_end=2024-04-03 03:20:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:20:05.813282276Z [2024-04-03T03:20:05.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:20:00+00:00, run_after=2024-04-03T03:21:00+00:00 2024-04-03T03:20:05.858156556Z [2024-04-03T03:20:05.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:19:00+00:00 exited with status success for try_number 1 2024-04-03T03:20:05.858309874Z [2024-04-03T03:20:05.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:19:00+00:00 exited with status success for try_number 1 2024-04-03T03:20:05.871509138Z [2024-04-03T03:20:05.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:19:00+00:00, map_index=-1, run_start_date=2024-04-03 03:20:03.472954+00:00, run_end_date=2024-04-03 03:20:05.483378+00:00, run_duration=2.010424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:20:00.531069+00:00, queued_by_job_id=1, pid=8859 2024-04-03T03:20:05.871734552Z [2024-04-03T03:20:05.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:19:00+00:00, map_index=-1, run_start_date=2024-04-03 03:20:03.900084+00:00, run_end_date=2024-04-03 03:20:05.575676+00:00, run_duration=1.675592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:20:00.531069+00:00, queued_by_job_id=1, pid=8870 2024-04-03T03:20:07.440721376Z [2024-04-03T03:20:07.440+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:20:07.440760117Z 2024-04-03T03:20:07.440764839Z [2024-04-03T03:20:07.440+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:20:07.441357713Z [2024-04-03T03:20:07.441+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:20:07.441369203Z 2024-04-03T03:20:07.444400705Z [2024-04-03T03:20:07.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:20:07.444735882Z [2024-04-03T03:20:07.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:20:07.504470634Z [2024-04-03T03:20:07.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status queued for try_number 1 2024-04-03T03:20:07.506691229Z [2024-04-03T03:20:07.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status success for try_number 1 2024-04-03T03:20:07.512795309Z [2024-04-03T03:20:07.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14d99e28-7be1-48a3-a049-3ea719457491 2024-04-03T03:20:07.513058424Z [2024-04-03T03:20:07.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:15:00+00:00, map_index=-1, run_start_date=2024-04-03 03:20:06.523429+00:00, run_end_date=2024-04-03 03:20:06.882143+00:00, run_duration=0.358714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:20:04.514574+00:00, queued_by_job_id=1, pid=8909 2024-04-03T03:20:10.862870613Z [2024-04-03T03:20:10.862+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:20:10.862887712Z 2024-04-03T03:20:10.862944469Z [2024-04-03T03:20:10.862+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:20:10.863542555Z [2024-04-03T03:20:10.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:20:10.863549799Z 2024-04-03T03:20:10.867776661Z [2024-04-03T03:20:10.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:20:10.867968977Z [2024-04-03T03:20:10.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:20:10.914849896Z [2024-04-03T03:20:10.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status queued for try_number 1 2024-04-03T03:20:10.915007083Z [2024-04-03T03:20:10.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status success for try_number 1 2024-04-03T03:20:10.921314620Z [2024-04-03T03:20:10.920+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb865705-595c-4a9e-a1ed-436418c8f48b 2024-04-03T03:20:10.922101226Z [2024-04-03T03:20:10.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:15:00+00:00, map_index=0, run_start_date=2024-04-03 03:20:09.072628+00:00, run_end_date=2024-04-03 03:20:10.544439+00:00, run_duration=1.471811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:20:07.441908+00:00, queued_by_job_id=1, pid=8921 2024-04-03T03:20:13.698548707Z [2024-04-03T03:20:13.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:20:13.698759930Z [2024-04-03T03:20:13.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:15:00+00:00, run_id=scheduled__2024-04-03T03:15:00+00:00, run_start_date=2024-04-03 03:20:00.455411+00:00, run_end_date=2024-04-03 03:20:13.698406+00:00, run_duration=13.242995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:15:00+00:00, data_interval_end=2024-04-03 03:20:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:20:13.705098579Z [2024-04-03T03:20:13.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:20:00+00:00, run_after=2024-04-03T03:25:00+00:00 2024-04-03T03:20:13.738410218Z [2024-04-03T03:20:13.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:15:00+00:00 exited with status success for try_number 1 2024-04-03T03:20:13.743997283Z [2024-04-03T03:20:13.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:15:00+00:00, map_index=-1, run_start_date=2024-04-03 03:20:12.732892+00:00, run_end_date=2024-04-03 03:20:13.194709+00:00, run_duration=0.461817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:20:10.864897+00:00, queued_by_job_id=1, pid=8942 2024-04-03T03:21:00.391195365Z [2024-04-03T03:21:00.390+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:21:00.405881033Z [2024-04-03T03:21:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:21:00+00:00, run_after=2024-04-03T03:22:00+00:00 2024-04-03T03:21:00.467966848Z [2024-04-03T03:21:00.467+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:21:00.467990935Z 2024-04-03T03:21:00.467995082Z 2024-04-03T03:21:00.468127611Z [2024-04-03T03:21:00.467+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:21:00.468370095Z [2024-04-03T03:21:00.468+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:21:00.469097496Z [2024-04-03T03:21:00.468+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:21:00.469109963Z 2024-04-03T03:21:00.469113842Z 2024-04-03T03:21:00.471860716Z [2024-04-03T03:21:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:21:00.472073298Z [2024-04-03T03:21:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:21:00.472379236Z [2024-04-03T03:21:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:21:00.472551804Z [2024-04-03T03:21:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:21:00.798422010Z [2024-04-03T03:21:00.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status queued for try_number 1 2024-04-03T03:21:00.798459867Z [2024-04-03T03:21:00.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status queued for try_number 1 2024-04-03T03:21:00.820793739Z [2024-04-03T03:21:00.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92cdea51-e53b-4561-8d02-133707349e74 2024-04-03T03:21:00.820817695Z [2024-04-03T03:21:00.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f114ca7-c514-4644-acce-a41e3d312f2c 2024-04-03T03:21:06.145194893Z [2024-04-03T03:21:06.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:21:06.145613705Z [2024-04-03T03:21:06.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:20:00+00:00, run_id=scheduled__2024-04-03T03:20:00+00:00, run_start_date=2024-04-03 03:21:00.418984+00:00, run_end_date=2024-04-03 03:21:06.145124+00:00, run_duration=5.72614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:20:00+00:00, data_interval_end=2024-04-03 03:21:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:21:06.165540019Z [2024-04-03T03:21:06.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:21:00+00:00, run_after=2024-04-03T03:22:00+00:00 2024-04-03T03:21:06.181459464Z [2024-04-03T03:21:06.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:21:06.181900065Z [2024-04-03T03:21:06.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:20:00+00:00, run_id=scheduled__2024-04-03T03:20:00+00:00, run_start_date=2024-04-03 03:21:00.417712+00:00, run_end_date=2024-04-03 03:21:06.181391+00:00, run_duration=5.763679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:20:00+00:00, data_interval_end=2024-04-03 03:21:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:21:06.193097229Z [2024-04-03T03:21:06.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:21:00+00:00, run_after=2024-04-03T03:22:00+00:00 2024-04-03T03:21:06.227857557Z [2024-04-03T03:21:06.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status success for try_number 1 2024-04-03T03:21:06.227878527Z [2024-04-03T03:21:06.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status success for try_number 1 2024-04-03T03:21:06.232392220Z [2024-04-03T03:21:06.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:20:00+00:00, map_index=-1, run_start_date=2024-04-03 03:21:02.583203+00:00, run_end_date=2024-04-03 03:21:05.123664+00:00, run_duration=2.540461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:21:00.469737+00:00, queued_by_job_id=1, pid=8969 2024-04-03T03:21:06.232693848Z [2024-04-03T03:21:06.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:20:00+00:00, map_index=-1, run_start_date=2024-04-03 03:21:03.127986+00:00, run_end_date=2024-04-03 03:21:05.526410+00:00, run_duration=2.398424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:21:00.469737+00:00, queued_by_job_id=1, pid=8988 2024-04-03T03:21:36.089687934Z [2024-04-03T03:21:36.089+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:22:00.065625269Z [2024-04-03T03:22:00.065+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:22:00.074206311Z [2024-04-03T03:22:00.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:22:00.114100652Z [2024-04-03T03:22:00.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:22:00+00:00, run_after=2024-04-03T03:23:00+00:00 2024-04-03T03:22:00.206914818Z [2024-04-03T03:22:00.206+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:22:00.206943270Z 2024-04-03T03:22:00.206947735Z 2024-04-03T03:22:00.206950983Z 2024-04-03T03:22:00.206954769Z [2024-04-03T03:22:00.206+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:22:00.206958043Z [2024-04-03T03:22:00.206+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:22:00.206961079Z [2024-04-03T03:22:00.206+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:22:00.207654181Z [2024-04-03T03:22:00.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:22:00.207670093Z 2024-04-03T03:22:00.207673852Z 2024-04-03T03:22:00.207677149Z 2024-04-03T03:22:00.211434251Z [2024-04-03T03:22:00.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:22:00.211451248Z [2024-04-03T03:22:00.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:22:00.211467513Z [2024-04-03T03:22:00.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:22:00.211471175Z [2024-04-03T03:22:00.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:22:00.211510640Z [2024-04-03T03:22:00.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:22:00.211514686Z [2024-04-03T03:22:00.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:22:00.632568885Z [2024-04-03T03:22:00.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status queued for try_number 1 2024-04-03T03:22:00.633850128Z [2024-04-03T03:22:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:21:00+00:00 exited with status queued for try_number 1 2024-04-03T03:22:00.634097783Z [2024-04-03T03:22:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:21:00+00:00 exited with status queued for try_number 1 2024-04-03T03:22:00.647309409Z [2024-04-03T03:22:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99bbe904-5b32-47f0-a8f3-bdcd6881cd39 2024-04-03T03:22:00.648133138Z [2024-04-03T03:22:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd887656-3696-4eea-813f-26e03f0fc207 2024-04-03T03:22:00.648721496Z [2024-04-03T03:22:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to b96624b3-3368-446a-a5fd-529fed5a07ac 2024-04-03T03:22:02.907805847Z [2024-04-03T03:22:02.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:22:02.908126826Z [2024-04-03T03:22:02.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:20:00+00:00, run_id=scheduled__2024-04-03T03:20:00+00:00, run_start_date=2024-04-03 03:22:00.123660+00:00, run_end_date=2024-04-03 03:22:02.907737+00:00, run_duration=2.784077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:20:00+00:00, data_interval_end=2024-04-03 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:22:02.915498373Z [2024-04-03T03:22:02.915+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:22:00+00:00, run_after=2024-04-03T03:24:00+00:00 2024-04-03T03:22:02.967697615Z [2024-04-03T03:22:02.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status success for try_number 1 2024-04-03T03:22:02.975655728Z [2024-04-03T03:22:02.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:20:00+00:00, map_index=-1, run_start_date=2024-04-03 03:22:01.737699+00:00, run_end_date=2024-04-03 03:22:02.194772+00:00, run_duration=0.457073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:22:00.208368+00:00, queued_by_job_id=1, pid=9016 2024-04-03T03:22:05.162424091Z [2024-04-03T03:22:05.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:22:05.162556751Z [2024-04-03T03:22:05.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:21:00+00:00, run_id=scheduled__2024-04-03T03:21:00+00:00, run_start_date=2024-04-03 03:22:00.125775+00:00, run_end_date=2024-04-03 03:22:05.162318+00:00, run_duration=5.036543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:21:00+00:00, data_interval_end=2024-04-03 03:22:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:22:05.171479006Z [2024-04-03T03:22:05.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:22:00+00:00, run_after=2024-04-03T03:23:00+00:00 2024-04-03T03:22:05.177589507Z [2024-04-03T03:22:05.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:22:05.177761613Z [2024-04-03T03:22:05.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:21:00+00:00, run_id=scheduled__2024-04-03T03:21:00+00:00, run_start_date=2024-04-03 03:22:00.124801+00:00, run_end_date=2024-04-03 03:22:05.177534+00:00, run_duration=5.052733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:21:00+00:00, data_interval_end=2024-04-03 03:22:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:22:05.187842134Z [2024-04-03T03:22:05.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:22:00+00:00, run_after=2024-04-03T03:23:00+00:00 2024-04-03T03:22:05.221169116Z [2024-04-03T03:22:05.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:21:00+00:00 exited with status success for try_number 1 2024-04-03T03:22:05.221197562Z [2024-04-03T03:22:05.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:21:00+00:00 exited with status success for try_number 1 2024-04-03T03:22:05.231113961Z [2024-04-03T03:22:05.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:21:00+00:00, map_index=-1, run_start_date=2024-04-03 03:22:03.078055+00:00, run_end_date=2024-04-03 03:22:05.035058+00:00, run_duration=1.957003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:22:00.208368+00:00, queued_by_job_id=1, pid=9055 2024-04-03T03:22:05.231210493Z [2024-04-03T03:22:05.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:21:00+00:00, map_index=-1, run_start_date=2024-04-03 03:22:02.608686+00:00, run_end_date=2024-04-03 03:22:04.644033+00:00, run_duration=2.035347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:22:00.208368+00:00, queued_by_job_id=1, pid=9036 2024-04-03T03:23:00.842346308Z [2024-04-03T03:23:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:23:00+00:00, run_after=2024-04-03T03:24:00+00:00 2024-04-03T03:23:00.850756808Z [2024-04-03T03:23:00.850+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:23:00.919027968Z [2024-04-03T03:23:00.918+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:23:00.919043730Z 2024-04-03T03:23:00.919047242Z 2024-04-03T03:23:00.919268743Z [2024-04-03T03:23:00.919+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:23:00.919588575Z [2024-04-03T03:23:00.919+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:23:00.920537208Z [2024-04-03T03:23:00.920+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:23:00.920542566Z 2024-04-03T03:23:00.920545909Z 2024-04-03T03:23:00.923895389Z [2024-04-03T03:23:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:23:00.923996379Z [2024-04-03T03:23:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:23:00.924316346Z [2024-04-03T03:23:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:23:00.924432670Z [2024-04-03T03:23:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:23:01.137965706Z [2024-04-03T03:23:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:22:00+00:00 exited with status queued for try_number 1 2024-04-03T03:23:01.138081330Z [2024-04-03T03:23:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:22:00+00:00 exited with status queued for try_number 1 2024-04-03T03:23:01.151710189Z [2024-04-03T03:23:01.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4da4b32-110c-4580-ba4d-2a272c864396 2024-04-03T03:23:01.151887123Z [2024-04-03T03:23:01.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to fabc4485-15e1-44f7-82fd-0bc8cd0a32a5 2024-04-03T03:23:04.452750242Z [2024-04-03T03:23:04.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:23:04.453093851Z [2024-04-03T03:23:04.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:22:00+00:00, run_id=scheduled__2024-04-03T03:22:00+00:00, run_start_date=2024-04-03 03:23:00.865280+00:00, run_end_date=2024-04-03 03:23:04.452738+00:00, run_duration=3.587458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:22:00+00:00, data_interval_end=2024-04-03 03:23:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:23:04.462963516Z [2024-04-03T03:23:04.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:23:00+00:00, run_after=2024-04-03T03:24:00+00:00 2024-04-03T03:23:04.882638305Z [2024-04-03T03:23:04.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:22:00+00:00 exited with status success for try_number 1 2024-04-03T03:23:04.888754688Z [2024-04-03T03:23:04.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:22:00+00:00, map_index=-1, run_start_date=2024-04-03 03:23:02.825674+00:00, run_end_date=2024-04-03 03:23:04.407035+00:00, run_duration=1.581361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:23:00.921180+00:00, queued_by_job_id=1, pid=9101 2024-04-03T03:23:06.858563861Z [2024-04-03T03:23:06.858+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:23:06.858875063Z [2024-04-03T03:23:06.858+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:22:00+00:00, run_id=scheduled__2024-04-03T03:22:00+00:00, run_start_date=2024-04-03 03:23:00.867140+00:00, run_end_date=2024-04-03 03:23:06.858413+00:00, run_duration=5.991273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:22:00+00:00, data_interval_end=2024-04-03 03:23:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:23:06.868217812Z [2024-04-03T03:23:06.867+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:23:00+00:00, run_after=2024-04-03T03:24:00+00:00 2024-04-03T03:23:06.902628067Z [2024-04-03T03:23:06.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:22:00+00:00 exited with status success for try_number 1 2024-04-03T03:23:06.908218878Z [2024-04-03T03:23:06.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:22:00+00:00, map_index=-1, run_start_date=2024-04-03 03:23:02.964626+00:00, run_end_date=2024-04-03 03:23:06.064536+00:00, run_duration=3.09991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:23:00.921180+00:00, queued_by_job_id=1, pid=9102 2024-04-03T03:24:00.369782897Z [2024-04-03T03:24:00.369+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:24:00.383545451Z [2024-04-03T03:24:00.383+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:24:00.398529320Z [2024-04-03T03:24:00.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:24:00+00:00, run_after=2024-04-03T03:25:00+00:00 2024-04-03T03:24:00.466233347Z [2024-04-03T03:24:00.465+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:24:00.466259395Z 2024-04-03T03:24:00.466263552Z 2024-04-03T03:24:00.466266817Z 2024-04-03T03:24:00.466471703Z [2024-04-03T03:24:00.466+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:24:00.466697978Z [2024-04-03T03:24:00.466+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:24:00.466934314Z [2024-04-03T03:24:00.466+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:24:00.467762651Z [2024-04-03T03:24:00.467+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:24:00.467779781Z 2024-04-03T03:24:00.467787524Z 2024-04-03T03:24:00.467794265Z 2024-04-03T03:24:00.472295479Z [2024-04-03T03:24:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:24:00.472525333Z [2024-04-03T03:24:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:24:00.472825624Z [2024-04-03T03:24:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:24:00.473001824Z [2024-04-03T03:24:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:24:00.473394446Z [2024-04-03T03:24:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:24:00.473543252Z [2024-04-03T03:24:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:24:00.883823112Z [2024-04-03T03:24:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:22:00+00:00 exited with status queued for try_number 1 2024-04-03T03:24:00.884079186Z [2024-04-03T03:24:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:23:00+00:00 exited with status queued for try_number 1 2024-04-03T03:24:00.884262823Z [2024-04-03T03:24:00.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:23:00+00:00 exited with status queued for try_number 1 2024-04-03T03:24:00.893195288Z [2024-04-03T03:24:00.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 475833c4-4373-44f2-95b0-6d694304e982 2024-04-03T03:24:00.893397315Z [2024-04-03T03:24:00.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ef83ae8-b90a-47dd-850f-63765f461d2f 2024-04-03T03:24:00.893654238Z [2024-04-03T03:24:00.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to c460caf5-6fc7-403d-8765-5e0e788bbf05 2024-04-03T03:24:02.106915470Z [2024-04-03T03:24:02.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:24:02.107157396Z [2024-04-03T03:24:02.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:22:00+00:00, run_id=scheduled__2024-04-03T03:22:00+00:00, run_start_date=2024-04-03 03:24:00.408542+00:00, run_end_date=2024-04-03 03:24:02.106818+00:00, run_duration=1.698276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:22:00+00:00, data_interval_end=2024-04-03 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:24:02.116034654Z [2024-04-03T03:24:02.115+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:24:00+00:00, run_after=2024-04-03T03:26:00+00:00 2024-04-03T03:24:02.184964005Z [2024-04-03T03:24:02.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:22:00+00:00 exited with status success for try_number 1 2024-04-03T03:24:02.191019517Z [2024-04-03T03:24:02.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:22:00+00:00, map_index=-1, run_start_date=2024-04-03 03:24:01.398035+00:00, run_end_date=2024-04-03 03:24:01.827769+00:00, run_duration=0.429734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:24:00.469131+00:00, queued_by_job_id=1, pid=9137 2024-04-03T03:24:04.367195332Z [2024-04-03T03:24:04.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:24:04.367452755Z [2024-04-03T03:24:04.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:23:00+00:00, run_id=scheduled__2024-04-03T03:23:00+00:00, run_start_date=2024-04-03 03:24:00.409937+00:00, run_end_date=2024-04-03 03:24:04.367023+00:00, run_duration=3.957086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:23:00+00:00, data_interval_end=2024-04-03 03:24:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:24:04.377697542Z [2024-04-03T03:24:04.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:24:00+00:00, run_after=2024-04-03T03:25:00+00:00 2024-04-03T03:24:04.415858975Z [2024-04-03T03:24:04.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:23:00+00:00 exited with status success for try_number 1 2024-04-03T03:24:04.420282460Z [2024-04-03T03:24:04.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:23:00+00:00, map_index=-1, run_start_date=2024-04-03 03:24:02.698180+00:00, run_end_date=2024-04-03 03:24:04.067827+00:00, run_duration=1.369647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:24:00.469131+00:00, queued_by_job_id=1, pid=9167 2024-04-03T03:24:05.460540414Z [2024-04-03T03:24:05.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:24:05.461269183Z [2024-04-03T03:24:05.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:23:00+00:00, run_id=scheduled__2024-04-03T03:23:00+00:00, run_start_date=2024-04-03 03:24:00.411111+00:00, run_end_date=2024-04-03 03:24:05.460663+00:00, run_duration=5.049552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:23:00+00:00, data_interval_end=2024-04-03 03:24:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:24:05.471487976Z [2024-04-03T03:24:05.471+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:24:00+00:00, run_after=2024-04-03T03:25:00+00:00 2024-04-03T03:24:05.499471504Z [2024-04-03T03:24:05.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:23:00+00:00 exited with status success for try_number 1 2024-04-03T03:24:05.506363320Z [2024-04-03T03:24:05.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:23:00+00:00, map_index=-1, run_start_date=2024-04-03 03:24:02.763775+00:00, run_end_date=2024-04-03 03:24:04.443887+00:00, run_duration=1.680112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:24:00.469131+00:00, queued_by_job_id=1, pid=9168 2024-04-03T03:25:00.905910837Z [2024-04-03T03:25:00.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:25:00+00:00, run_after=2024-04-03T03:26:00+00:00 2024-04-03T03:25:00.921164591Z [2024-04-03T03:25:00.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:25:00+00:00, run_after=2024-04-03T03:30:00+00:00 2024-04-03T03:25:00.928140553Z [2024-04-03T03:25:00.927+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:25:00.992418697Z [2024-04-03T03:25:00.992+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:25:00.992460692Z 2024-04-03T03:25:00.992468398Z 2024-04-03T03:25:00.992474823Z 2024-04-03T03:25:00.992785708Z [2024-04-03T03:25:00.992+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:25:00.993081654Z [2024-04-03T03:25:00.992+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:25:00.993825970Z [2024-04-03T03:25:00.993+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:25:00.994439964Z [2024-04-03T03:25:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:25:00.994453907Z 2024-04-03T03:25:00.994457611Z 2024-04-03T03:25:00.994460950Z 2024-04-03T03:25:01.000774381Z [2024-04-03T03:25:01.000+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:25:01.001375571Z [2024-04-03T03:25:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:25:01.001690620Z [2024-04-03T03:25:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:25:01.001817139Z [2024-04-03T03:25:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:25:01.002243184Z [2024-04-03T03:25:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:25:01.002379353Z [2024-04-03T03:25:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:25:01.331795224Z [2024-04-03T03:25:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status queued for try_number 1 2024-04-03T03:25:01.331954907Z [2024-04-03T03:25:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:24:00+00:00 exited with status queued for try_number 1 2024-04-03T03:25:01.332100540Z [2024-04-03T03:25:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:24:00+00:00 exited with status queued for try_number 1 2024-04-03T03:25:01.359879771Z [2024-04-03T03:25:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to aaa2ce8f-b7db-4f94-acf9-339852e1fd63 2024-04-03T03:25:01.360367652Z [2024-04-03T03:25:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48bd9635-d0b4-4bcd-93e1-a0be9842ef59 2024-04-03T03:25:01.360536930Z [2024-04-03T03:25:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55342c91-207e-4d53-935c-050fcd1e8dfa 2024-04-03T03:25:04.082030793Z [2024-04-03T03:25:04.080+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:25:04.082072413Z 2024-04-03T03:25:04.082284049Z [2024-04-03T03:25:04.082+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:25:04.082895067Z [2024-04-03T03:25:04.082+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:25:04.082906020Z 2024-04-03T03:25:04.085508168Z [2024-04-03T03:25:04.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:25:04.085688950Z [2024-04-03T03:25:04.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:25:04.202492865Z [2024-04-03T03:25:04.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status queued for try_number 1 2024-04-03T03:25:04.202689672Z [2024-04-03T03:25:04.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status success for try_number 1 2024-04-03T03:25:04.216237645Z [2024-04-03T03:25:04.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1acca692-116a-4f55-8272-acf3c57a4281 2024-04-03T03:25:04.216572220Z [2024-04-03T03:25:04.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:20:00+00:00, map_index=-1, run_start_date=2024-04-03 03:25:03.024569+00:00, run_end_date=2024-04-03 03:25:03.438095+00:00, run_duration=0.413526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:25:00.996232+00:00, queued_by_job_id=1, pid=9235 2024-04-03T03:25:04.281328333Z [2024-04-03T03:25:04.280+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:25:04.281755410Z [2024-04-03T03:25:04.281+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:24:00+00:00, run_id=scheduled__2024-04-03T03:24:00+00:00, run_start_date=2024-04-03 03:25:00.939171+00:00, run_end_date=2024-04-03 03:25:04.281370+00:00, run_duration=3.342199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:24:00+00:00, data_interval_end=2024-04-03 03:25:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:25:04.290466698Z [2024-04-03T03:25:04.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:25:00+00:00, run_after=2024-04-03T03:26:00+00:00 2024-04-03T03:25:05.386833639Z [2024-04-03T03:25:05.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:25:05.387110854Z [2024-04-03T03:25:05.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:24:00+00:00, run_id=scheduled__2024-04-03T03:24:00+00:00, run_start_date=2024-04-03 03:25:00.940183+00:00, run_end_date=2024-04-03 03:25:05.386723+00:00, run_duration=4.44654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:24:00+00:00, data_interval_end=2024-04-03 03:25:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:25:05.398634778Z [2024-04-03T03:25:05.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:25:00+00:00, run_after=2024-04-03T03:26:00+00:00 2024-04-03T03:25:05.440397179Z [2024-04-03T03:25:05.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:24:00+00:00 exited with status success for try_number 1 2024-04-03T03:25:05.440800864Z [2024-04-03T03:25:05.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:24:00+00:00 exited with status success for try_number 1 2024-04-03T03:25:05.447874240Z [2024-04-03T03:25:05.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:24:00+00:00, map_index=-1, run_start_date=2024-04-03 03:25:03.309944+00:00, run_end_date=2024-04-03 03:25:05.146554+00:00, run_duration=1.83661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:25:00.996232+00:00, queued_by_job_id=1, pid=9251 2024-04-03T03:25:05.448200420Z [2024-04-03T03:25:05.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:24:00+00:00, map_index=-1, run_start_date=2024-04-03 03:25:02.976090+00:00, run_end_date=2024-04-03 03:25:04.227841+00:00, run_duration=1.251751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:25:00.996232+00:00, queued_by_job_id=1, pid=9234 2024-04-03T03:25:06.472440810Z [2024-04-03T03:25:06.472+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:25:06.472465092Z 2024-04-03T03:25:06.473956689Z [2024-04-03T03:25:06.473+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:25:06.477858503Z [2024-04-03T03:25:06.477+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:25:06.477903427Z 2024-04-03T03:25:06.481611571Z [2024-04-03T03:25:06.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:25:06.482071300Z [2024-04-03T03:25:06.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:25:06.549901733Z [2024-04-03T03:25:06.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status queued for try_number 1 2024-04-03T03:25:06.550722963Z [2024-04-03T03:25:06.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status success for try_number 1 2024-04-03T03:25:06.556210852Z [2024-04-03T03:25:06.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00820f60-9f40-4f68-b75d-22144ebf6c87 2024-04-03T03:25:06.556405598Z [2024-04-03T03:25:06.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:20:00+00:00, map_index=-1, run_start_date=2024-04-03 03:25:05.780232+00:00, run_end_date=2024-04-03 03:25:06.060076+00:00, run_duration=0.279844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:25:04.083471+00:00, queued_by_job_id=1, pid=9274 2024-04-03T03:25:09.823356811Z [2024-04-03T03:25:09.822+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:25:09.823381695Z 2024-04-03T03:25:09.823388368Z [2024-04-03T03:25:09.822+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:25:09.823458417Z [2024-04-03T03:25:09.823+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:25:09.823462899Z 2024-04-03T03:25:09.825516357Z [2024-04-03T03:25:09.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:25:09.825588070Z [2024-04-03T03:25:09.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:25:09.894833387Z [2024-04-03T03:25:09.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status queued for try_number 1 2024-04-03T03:25:09.895190497Z [2024-04-03T03:25:09.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status success for try_number 1 2024-04-03T03:25:09.904442277Z [2024-04-03T03:25:09.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8586622d-ce05-4fda-9a41-b2c2e2c87e7f 2024-04-03T03:25:09.904995202Z [2024-04-03T03:25:09.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:20:00+00:00, map_index=0, run_start_date=2024-04-03 03:25:08.143785+00:00, run_end_date=2024-04-03 03:25:09.379303+00:00, run_duration=1.235518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:25:06.479625+00:00, queued_by_job_id=1, pid=9286 2024-04-03T03:25:13.005552894Z [2024-04-03T03:25:13.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:25:13.006347521Z [2024-04-03T03:25:13.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:20:00+00:00, run_id=scheduled__2024-04-03T03:20:00+00:00, run_start_date=2024-04-03 03:25:00.937726+00:00, run_end_date=2024-04-03 03:25:13.005460+00:00, run_duration=12.067734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:20:00+00:00, data_interval_end=2024-04-03 03:25:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:25:13.014855337Z [2024-04-03T03:25:13.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:25:00+00:00, run_after=2024-04-03T03:30:00+00:00 2024-04-03T03:25:13.059115931Z [2024-04-03T03:25:13.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:20:00+00:00 exited with status success for try_number 1 2024-04-03T03:25:13.066568540Z [2024-04-03T03:25:13.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:20:00+00:00, map_index=-1, run_start_date=2024-04-03 03:25:11.700688+00:00, run_end_date=2024-04-03 03:25:12.090755+00:00, run_duration=0.390067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:25:09.823768+00:00, queued_by_job_id=1, pid=9307 2024-04-03T03:26:00.600590377Z [2024-04-03T03:26:00.600+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:26:00.609777800Z [2024-04-03T03:26:00.608+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:26:00.622774153Z [2024-04-03T03:26:00.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:26:00+00:00, run_after=2024-04-03T03:27:00+00:00 2024-04-03T03:26:00.709540874Z [2024-04-03T03:26:00.709+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:26:00.709568262Z 2024-04-03T03:26:00.709572489Z 2024-04-03T03:26:00.709576168Z 2024-04-03T03:26:00.709600993Z [2024-04-03T03:26:00.709+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:26:00.709651723Z [2024-04-03T03:26:00.709+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:26:00.709731578Z [2024-04-03T03:26:00.709+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:26:00.712750751Z [2024-04-03T03:26:00.712+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:26:00.712772803Z 2024-04-03T03:26:00.712776691Z 2024-04-03T03:26:00.712779824Z 2024-04-03T03:26:00.717228362Z [2024-04-03T03:26:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:26:00.717302254Z [2024-04-03T03:26:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:26:00.717950696Z [2024-04-03T03:26:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:26:00.718024058Z [2024-04-03T03:26:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:26:00.718203684Z [2024-04-03T03:26:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:26:00.718261023Z [2024-04-03T03:26:00.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:26:01.098174287Z [2024-04-03T03:26:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:24:00+00:00 exited with status queued for try_number 1 2024-04-03T03:26:01.098211801Z [2024-04-03T03:26:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status queued for try_number 1 2024-04-03T03:26:01.098279895Z [2024-04-03T03:26:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status queued for try_number 1 2024-04-03T03:26:01.116153930Z [2024-04-03T03:26:01.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02c5897c-5824-42e8-8025-bf07568dc8f1 2024-04-03T03:26:01.116203408Z [2024-04-03T03:26:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to b149e1ab-db75-4c80-be28-7a7a088889a7 2024-04-03T03:26:01.116301714Z [2024-04-03T03:26:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5b8641b-a184-44d9-a8a1-fe7faeaa7980 2024-04-03T03:26:02.268386583Z [2024-04-03T03:26:02.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:26:02.268794321Z [2024-04-03T03:26:02.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:24:00+00:00, run_id=scheduled__2024-04-03T03:24:00+00:00, run_start_date=2024-04-03 03:26:00.636847+00:00, run_end_date=2024-04-03 03:26:02.268388+00:00, run_duration=1.631541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:24:00+00:00, data_interval_end=2024-04-03 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:26:02.276463198Z [2024-04-03T03:26:02.276+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:26:00+00:00, run_after=2024-04-03T03:28:00+00:00 2024-04-03T03:26:02.323797729Z [2024-04-03T03:26:02.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:24:00+00:00 exited with status success for try_number 1 2024-04-03T03:26:02.331771031Z [2024-04-03T03:26:02.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:24:00+00:00, map_index=-1, run_start_date=2024-04-03 03:26:01.793909+00:00, run_end_date=2024-04-03 03:26:02.110088+00:00, run_duration=0.316179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:26:00.713605+00:00, queued_by_job_id=1, pid=9324 2024-04-03T03:26:04.707776977Z [2024-04-03T03:26:04.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:26:04.708149180Z [2024-04-03T03:26:04.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:25:00+00:00, run_id=scheduled__2024-04-03T03:25:00+00:00, run_start_date=2024-04-03 03:26:00.640627+00:00, run_end_date=2024-04-03 03:26:04.707877+00:00, run_duration=4.06725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:25:00+00:00, data_interval_end=2024-04-03 03:26:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:26:04.716800884Z [2024-04-03T03:26:04.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:26:00+00:00, run_after=2024-04-03T03:27:00+00:00 2024-04-03T03:26:04.724411921Z [2024-04-03T03:26:04.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:26:04.724765547Z [2024-04-03T03:26:04.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:25:00+00:00, run_id=scheduled__2024-04-03T03:25:00+00:00, run_start_date=2024-04-03 03:26:00.639396+00:00, run_end_date=2024-04-03 03:26:04.724313+00:00, run_duration=4.084917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:25:00+00:00, data_interval_end=2024-04-03 03:26:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:26:04.734636747Z [2024-04-03T03:26:04.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:26:00+00:00, run_after=2024-04-03T03:27:00+00:00 2024-04-03T03:26:04.772106054Z [2024-04-03T03:26:04.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status success for try_number 1 2024-04-03T03:26:04.772300162Z [2024-04-03T03:26:04.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status success for try_number 1 2024-04-03T03:26:04.779821223Z [2024-04-03T03:26:04.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:25:00+00:00, map_index=-1, run_start_date=2024-04-03 03:26:02.909757+00:00, run_end_date=2024-04-03 03:26:04.492655+00:00, run_duration=1.582898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:26:00.713605+00:00, queued_by_job_id=1, pid=9355 2024-04-03T03:26:04.780036892Z [2024-04-03T03:26:04.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:25:00+00:00, map_index=-1, run_start_date=2024-04-03 03:26:02.710999+00:00, run_end_date=2024-04-03 03:26:04.226408+00:00, run_duration=1.515409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:26:00.713605+00:00, queued_by_job_id=1, pid=9347 2024-04-03T03:26:36.112024346Z [2024-04-03T03:26:36.110+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:27:00.431587154Z [2024-04-03T03:27:00.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:27:00+00:00, run_after=2024-04-03T03:28:00+00:00 2024-04-03T03:27:00.440617959Z [2024-04-03T03:27:00.440+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:27:00.514538450Z [2024-04-03T03:27:00.514+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:27:00.514566320Z 2024-04-03T03:27:00.514569965Z 2024-04-03T03:27:00.514721622Z [2024-04-03T03:27:00.514+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:27:00.514966883Z [2024-04-03T03:27:00.514+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:27:00.515578212Z [2024-04-03T03:27:00.515+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:27:00.515589637Z 2024-04-03T03:27:00.515593383Z 2024-04-03T03:27:00.519185530Z [2024-04-03T03:27:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:27:00.519507407Z [2024-04-03T03:27:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:27:00.519950114Z [2024-04-03T03:27:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:27:00.520236509Z [2024-04-03T03:27:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:27:00.723204863Z [2024-04-03T03:27:00.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:26:00+00:00 exited with status queued for try_number 1 2024-04-03T03:27:00.723416075Z [2024-04-03T03:27:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:26:00+00:00 exited with status queued for try_number 1 2024-04-03T03:27:00.734551384Z [2024-04-03T03:27:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d379e0d-3685-47a5-96b9-dc02c2fa1bcc 2024-04-03T03:27:00.734957356Z [2024-04-03T03:27:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f371d0a-0d21-45e0-8ddb-c0e33a85b769 2024-04-03T03:27:04.448903192Z [2024-04-03T03:27:04.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:27:04.449099653Z [2024-04-03T03:27:04.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:26:00+00:00, run_id=scheduled__2024-04-03T03:26:00+00:00, run_start_date=2024-04-03 03:27:00.461092+00:00, run_end_date=2024-04-03 03:27:04.448736+00:00, run_duration=3.987644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:26:00+00:00, data_interval_end=2024-04-03 03:27:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:27:04.462974578Z [2024-04-03T03:27:04.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:27:00+00:00, run_after=2024-04-03T03:28:00+00:00 2024-04-03T03:27:05.553595385Z [2024-04-03T03:27:05.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:27:05.553763731Z [2024-04-03T03:27:05.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:26:00+00:00, run_id=scheduled__2024-04-03T03:26:00+00:00, run_start_date=2024-04-03 03:27:00.459798+00:00, run_end_date=2024-04-03 03:27:05.553504+00:00, run_duration=5.093706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:26:00+00:00, data_interval_end=2024-04-03 03:27:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:27:05.562149468Z [2024-04-03T03:27:05.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:27:00+00:00, run_after=2024-04-03T03:28:00+00:00 2024-04-03T03:27:05.587707621Z [2024-04-03T03:27:05.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:26:00+00:00 exited with status success for try_number 1 2024-04-03T03:27:05.587757417Z [2024-04-03T03:27:05.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:26:00+00:00 exited with status success for try_number 1 2024-04-03T03:27:05.593400773Z [2024-04-03T03:27:05.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:26:00+00:00, map_index=-1, run_start_date=2024-04-03 03:27:02.512503+00:00, run_end_date=2024-04-03 03:27:04.390080+00:00, run_duration=1.877577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:27:00.516163+00:00, queued_by_job_id=1, pid=9409 2024-04-03T03:27:05.593544160Z [2024-04-03T03:27:05.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:26:00+00:00, map_index=-1, run_start_date=2024-04-03 03:27:02.681059+00:00, run_end_date=2024-04-03 03:27:04.597174+00:00, run_duration=1.916115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:27:00.516163+00:00, queued_by_job_id=1, pid=9410 2024-04-03T03:28:00.166336511Z [2024-04-03T03:28:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:28:00+00:00, run_after=2024-04-03T03:29:00+00:00 2024-04-03T03:28:00.185482479Z [2024-04-03T03:28:00.183+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:28:00.204922971Z [2024-04-03T03:28:00.191+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:28:00.275811688Z [2024-04-03T03:28:00.275+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:28:00.275860710Z 2024-04-03T03:28:00.275870456Z 2024-04-03T03:28:00.275873769Z 2024-04-03T03:28:00.276336226Z [2024-04-03T03:28:00.275+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:28:00.276671157Z [2024-04-03T03:28:00.276+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:28:00.276927448Z [2024-04-03T03:28:00.276+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:28:00.277578590Z [2024-04-03T03:28:00.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:28:00.277589724Z 2024-04-03T03:28:00.277593432Z 2024-04-03T03:28:00.277596714Z 2024-04-03T03:28:00.281107803Z [2024-04-03T03:28:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:28:00.287047645Z [2024-04-03T03:28:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:28:00.287510724Z [2024-04-03T03:28:00.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:28:00.287835063Z [2024-04-03T03:28:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:28:00.288223061Z [2024-04-03T03:28:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:28:00.288468369Z [2024-04-03T03:28:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:28:00.595814919Z [2024-04-03T03:28:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:26:00+00:00 exited with status queued for try_number 1 2024-04-03T03:28:00.603148581Z [2024-04-03T03:28:00.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:27:00+00:00 exited with status queued for try_number 1 2024-04-03T03:28:00.603258560Z [2024-04-03T03:28:00.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:27:00+00:00 exited with status queued for try_number 1 2024-04-03T03:28:00.620476413Z [2024-04-03T03:28:00.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6811204b-c9c7-428b-b436-b2a0b01e195f 2024-04-03T03:28:00.620623019Z [2024-04-03T03:28:00.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6b529ca-9190-4e2f-9391-27c0cd08ebbb 2024-04-03T03:28:00.620767807Z [2024-04-03T03:28:00.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0b5a8be-8a6b-4f6c-b058-f29c0d9678e6 2024-04-03T03:28:02.997019005Z [2024-04-03T03:28:02.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:28:02.999081734Z [2024-04-03T03:28:02.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:26:00+00:00, run_id=scheduled__2024-04-03T03:26:00+00:00, run_start_date=2024-04-03 03:28:00.219227+00:00, run_end_date=2024-04-03 03:28:02.996945+00:00, run_duration=2.777718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:26:00+00:00, data_interval_end=2024-04-03 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:28:03.023490116Z [2024-04-03T03:28:03.023+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:28:00+00:00, run_after=2024-04-03T03:30:00+00:00 2024-04-03T03:28:03.135829501Z [2024-04-03T03:28:03.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:26:00+00:00 exited with status success for try_number 1 2024-04-03T03:28:03.141466846Z [2024-04-03T03:28:03.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:26:00+00:00, map_index=-1, run_start_date=2024-04-03 03:28:01.581787+00:00, run_end_date=2024-04-03 03:28:02.100267+00:00, run_duration=0.51848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:28:00.278442+00:00, queued_by_job_id=1, pid=9445 2024-04-03T03:28:05.264473366Z [2024-04-03T03:28:05.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:28:05.264608924Z [2024-04-03T03:28:05.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:27:00+00:00, run_id=scheduled__2024-04-03T03:27:00+00:00, run_start_date=2024-04-03 03:28:00.220546+00:00, run_end_date=2024-04-03 03:28:05.264367+00:00, run_duration=5.043821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:27:00+00:00, data_interval_end=2024-04-03 03:28:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:28:05.272941392Z [2024-04-03T03:28:05.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:28:00+00:00, run_after=2024-04-03T03:29:00+00:00 2024-04-03T03:28:05.278865891Z [2024-04-03T03:28:05.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:28:05.279011462Z [2024-04-03T03:28:05.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:27:00+00:00, run_id=scheduled__2024-04-03T03:27:00+00:00, run_start_date=2024-04-03 03:28:00.221538+00:00, run_end_date=2024-04-03 03:28:05.278798+00:00, run_duration=5.05726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:27:00+00:00, data_interval_end=2024-04-03 03:28:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:28:05.288695175Z [2024-04-03T03:28:05.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:28:00+00:00, run_after=2024-04-03T03:29:00+00:00 2024-04-03T03:28:05.319248961Z [2024-04-03T03:28:05.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:27:00+00:00 exited with status success for try_number 1 2024-04-03T03:28:05.319278901Z [2024-04-03T03:28:05.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:27:00+00:00 exited with status success for try_number 1 2024-04-03T03:28:05.325544251Z [2024-04-03T03:28:05.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:27:00+00:00, map_index=-1, run_start_date=2024-04-03 03:28:02.783649+00:00, run_end_date=2024-04-03 03:28:04.203628+00:00, run_duration=1.419979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:28:00.278442+00:00, queued_by_job_id=1, pid=9475 2024-04-03T03:28:05.325762912Z [2024-04-03T03:28:05.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:27:00+00:00, map_index=-1, run_start_date=2024-04-03 03:28:02.782930+00:00, run_end_date=2024-04-03 03:28:04.841985+00:00, run_duration=2.059055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:28:00.278442+00:00, queued_by_job_id=1, pid=9476 2024-04-03T03:29:00.935621161Z [2024-04-03T03:29:00.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:29:00+00:00, run_after=2024-04-03T03:30:00+00:00 2024-04-03T03:29:00.943692998Z [2024-04-03T03:29:00.943+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:29:00.993955556Z [2024-04-03T03:29:00.993+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:29:00.993983513Z 2024-04-03T03:29:00.994006263Z 2024-04-03T03:29:00.994509875Z [2024-04-03T03:29:00.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:29:00.995008951Z [2024-04-03T03:29:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:29:00.996132095Z [2024-04-03T03:29:00.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:29:00.996146606Z 2024-04-03T03:29:00.996151669Z 2024-04-03T03:29:01.011178281Z [2024-04-03T03:29:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:29:01.011541275Z [2024-04-03T03:29:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:29:01.012022644Z [2024-04-03T03:29:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:29:01.012338392Z [2024-04-03T03:29:01.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:29:01.247307083Z [2024-04-03T03:29:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:28:00+00:00 exited with status queued for try_number 1 2024-04-03T03:29:01.247387805Z [2024-04-03T03:29:01.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:28:00+00:00 exited with status queued for try_number 1 2024-04-03T03:29:01.258644808Z [2024-04-03T03:29:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25b086e1-320e-448f-86a2-0a056f04a772 2024-04-03T03:29:01.259027426Z [2024-04-03T03:29:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to a86e1eaf-0452-44e0-b855-a7d298cf00ea 2024-04-03T03:29:06.028699444Z [2024-04-03T03:29:06.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:29:06.029187170Z [2024-04-03T03:29:06.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:28:00+00:00, run_id=scheduled__2024-04-03T03:28:00+00:00, run_start_date=2024-04-03 03:29:00.953114+00:00, run_end_date=2024-04-03 03:29:06.028571+00:00, run_duration=5.075457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:28:00+00:00, data_interval_end=2024-04-03 03:29:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:29:06.038420764Z [2024-04-03T03:29:06.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:29:00+00:00, run_after=2024-04-03T03:30:00+00:00 2024-04-03T03:29:06.107361613Z [2024-04-03T03:29:06.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:28:00+00:00 exited with status success for try_number 1 2024-04-03T03:29:06.114480515Z [2024-04-03T03:29:06.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:28:00+00:00, map_index=-1, run_start_date=2024-04-03 03:29:03.029503+00:00, run_end_date=2024-04-03 03:29:05.308086+00:00, run_duration=2.278583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:29:00.998698+00:00, queued_by_job_id=1, pid=9530 2024-04-03T03:29:07.172076076Z [2024-04-03T03:29:07.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:29:07.172365034Z [2024-04-03T03:29:07.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:28:00+00:00, run_id=scheduled__2024-04-03T03:28:00+00:00, run_start_date=2024-04-03 03:29:00.954269+00:00, run_end_date=2024-04-03 03:29:07.171967+00:00, run_duration=6.217698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:28:00+00:00, data_interval_end=2024-04-03 03:29:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:29:07.183063306Z [2024-04-03T03:29:07.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:29:00+00:00, run_after=2024-04-03T03:30:00+00:00 2024-04-03T03:29:07.227052900Z [2024-04-03T03:29:07.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:28:00+00:00 exited with status success for try_number 1 2024-04-03T03:29:07.235324514Z [2024-04-03T03:29:07.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:28:00+00:00, map_index=-1, run_start_date=2024-04-03 03:29:03.144255+00:00, run_end_date=2024-04-03 03:29:06.652187+00:00, run_duration=3.507932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:29:00.998698+00:00, queued_by_job_id=1, pid=9531 2024-04-03T03:30:00.521496842Z [2024-04-03T03:30:00.520+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:30:00.540737045Z [2024-04-03T03:30:00.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:30:00+00:00, run_after=2024-04-03T03:35:00+00:00 2024-04-03T03:30:00.548672673Z [2024-04-03T03:30:00.548+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:30:00.564803480Z [2024-04-03T03:30:00.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:30:00+00:00, run_after=2024-04-03T03:31:00+00:00 2024-04-03T03:30:00.682044690Z [2024-04-03T03:30:00.681+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T03:30:00.682068943Z 2024-04-03T03:30:00.682114923Z 2024-04-03T03:30:00.682120319Z 2024-04-03T03:30:00.682124982Z 2024-04-03T03:30:00.682943588Z [2024-04-03T03:30:00.682+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:30:00.683982671Z [2024-04-03T03:30:00.683+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:30:00.684323081Z [2024-04-03T03:30:00.684+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:30:00.685084592Z [2024-04-03T03:30:00.684+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:30:00.686730906Z [2024-04-03T03:30:00.686+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:30:00.686743673Z 2024-04-03T03:30:00.686747984Z 2024-04-03T03:30:00.686752254Z 2024-04-03T03:30:00.686755964Z 2024-04-03T03:30:00.693860349Z [2024-04-03T03:30:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:30:00.694393596Z [2024-04-03T03:30:00.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:30:00.695023732Z [2024-04-03T03:30:00.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:30:00.697949107Z [2024-04-03T03:30:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:30:00.698917273Z [2024-04-03T03:30:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:30:00.699661949Z [2024-04-03T03:30:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:30:00.700318349Z [2024-04-03T03:30:00.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:30:00.700719941Z [2024-04-03T03:30:00.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:30:01.235833365Z [2024-04-03T03:30:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status queued for try_number 1 2024-04-03T03:30:01.236153273Z [2024-04-03T03:30:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:28:00+00:00 exited with status queued for try_number 1 2024-04-03T03:30:01.236353463Z [2024-04-03T03:30:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:29:00+00:00 exited with status queued for try_number 1 2024-04-03T03:30:01.236593606Z [2024-04-03T03:30:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:29:00+00:00 exited with status queued for try_number 1 2024-04-03T03:30:01.256022739Z [2024-04-03T03:30:01.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04d0b7df-9fb4-4cbc-84d7-c7eda1479da9 2024-04-03T03:30:01.256482423Z [2024-04-03T03:30:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6de64489-f00b-46df-96e1-7f7d9221b653 2024-04-03T03:30:01.256781753Z [2024-04-03T03:30:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to c13e4f11-8255-4ea3-bd91-0af32b242e3f 2024-04-03T03:30:01.257037122Z [2024-04-03T03:30:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ea5c75e-6d1c-47ec-af5f-72766132cfa8 2024-04-03T03:30:02.690412025Z [2024-04-03T03:30:02.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:28:00+00:00 exited with status success for try_number 1 2024-04-03T03:30:02.699705985Z [2024-04-03T03:30:02.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:28:00+00:00, map_index=-1, run_start_date=2024-04-03 03:30:02.087533+00:00, run_end_date=2024-04-03 03:30:02.520918+00:00, run_duration=0.433385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:30:00.688319+00:00, queued_by_job_id=1, pid=9568 2024-04-03T03:30:03.843003132Z [2024-04-03T03:30:03.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:30:03.845666105Z [2024-04-03T03:30:03.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:28:00+00:00, run_id=scheduled__2024-04-03T03:28:00+00:00, run_start_date=2024-04-03 03:30:00.592517+00:00, run_end_date=2024-04-03 03:30:03.842885+00:00, run_duration=3.250368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:28:00+00:00, data_interval_end=2024-04-03 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:30:03.873472373Z [2024-04-03T03:30:03.873+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:30:00+00:00, run_after=2024-04-03T03:32:00+00:00 2024-04-03T03:30:05.163297913Z [2024-04-03T03:30:05.162+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:30:05.163366181Z 2024-04-03T03:30:05.163394444Z [2024-04-03T03:30:05.163+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:30:05.163978611Z [2024-04-03T03:30:05.163+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:30:05.164003750Z 2024-04-03T03:30:05.166818461Z [2024-04-03T03:30:05.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:30:05.166853477Z [2024-04-03T03:30:05.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:30:05.219529695Z [2024-04-03T03:30:05.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status queued for try_number 1 2024-04-03T03:30:05.219661274Z [2024-04-03T03:30:05.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status success for try_number 1 2024-04-03T03:30:05.224416577Z [2024-04-03T03:30:05.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to f390b6f1-7c29-4cde-9f26-06e215588663 2024-04-03T03:30:05.224513608Z [2024-04-03T03:30:05.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:25:00+00:00, map_index=-1, run_start_date=2024-04-03 03:30:03.994699+00:00, run_end_date=2024-04-03 03:30:04.484330+00:00, run_duration=0.489631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:30:00.688319+00:00, queued_by_job_id=1, pid=9608 2024-04-03T03:30:06.355971488Z [2024-04-03T03:30:06.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:30:06.356714322Z [2024-04-03T03:30:06.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:29:00+00:00, run_id=scheduled__2024-04-03T03:29:00+00:00, run_start_date=2024-04-03 03:30:00.594321+00:00, run_end_date=2024-04-03 03:30:06.355821+00:00, run_duration=5.7615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:29:00+00:00, data_interval_end=2024-04-03 03:30:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:30:06.367763955Z [2024-04-03T03:30:06.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:30:00+00:00, run_after=2024-04-03T03:31:00+00:00 2024-04-03T03:30:06.374819291Z [2024-04-03T03:30:06.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:30:06.375214268Z [2024-04-03T03:30:06.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:29:00+00:00, run_id=scheduled__2024-04-03T03:29:00+00:00, run_start_date=2024-04-03 03:30:00.595768+00:00, run_end_date=2024-04-03 03:30:06.374722+00:00, run_duration=5.778954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:29:00+00:00, data_interval_end=2024-04-03 03:30:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:30:06.383917568Z [2024-04-03T03:30:06.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:30:00+00:00, run_after=2024-04-03T03:31:00+00:00 2024-04-03T03:30:06.432395859Z [2024-04-03T03:30:06.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:29:00+00:00 exited with status success for try_number 1 2024-04-03T03:30:06.432433903Z [2024-04-03T03:30:06.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:29:00+00:00 exited with status success for try_number 1 2024-04-03T03:30:06.439071730Z [2024-04-03T03:30:06.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:29:00+00:00, map_index=-1, run_start_date=2024-04-03 03:30:03.907742+00:00, run_end_date=2024-04-03 03:30:05.639667+00:00, run_duration=1.731925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:30:00.688319+00:00, queued_by_job_id=1, pid=9609 2024-04-03T03:30:06.439137366Z [2024-04-03T03:30:06.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:29:00+00:00, map_index=-1, run_start_date=2024-04-03 03:30:03.893287+00:00, run_end_date=2024-04-03 03:30:05.914406+00:00, run_duration=2.021119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:30:00.688319+00:00, queued_by_job_id=1, pid=9607 2024-04-03T03:30:07.508526140Z [2024-04-03T03:30:07.507+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:30:07.508603311Z 2024-04-03T03:30:07.509052356Z [2024-04-03T03:30:07.508+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:30:07.510505190Z [2024-04-03T03:30:07.509+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:30:07.510517368Z 2024-04-03T03:30:07.514108918Z [2024-04-03T03:30:07.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:30:07.514210459Z [2024-04-03T03:30:07.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:30:07.570419016Z [2024-04-03T03:30:07.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status queued for try_number 1 2024-04-03T03:30:07.570908609Z [2024-04-03T03:30:07.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status success for try_number 1 2024-04-03T03:30:07.577075218Z [2024-04-03T03:30:07.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdf8a4a2-55eb-4783-882e-f174f5358f07 2024-04-03T03:30:07.577471778Z [2024-04-03T03:30:07.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:25:00+00:00, map_index=-1, run_start_date=2024-04-03 03:30:06.884987+00:00, run_end_date=2024-04-03 03:30:07.241652+00:00, run_duration=0.356665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:30:05.164258+00:00, queued_by_job_id=1, pid=9648 2024-04-03T03:30:11.010984540Z [2024-04-03T03:30:11.010+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:30:11.011024007Z 2024-04-03T03:30:11.011159765Z [2024-04-03T03:30:11.010+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:30:11.011843079Z [2024-04-03T03:30:11.011+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:30:11.011868024Z 2024-04-03T03:30:11.014715245Z [2024-04-03T03:30:11.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:30:11.014906988Z [2024-04-03T03:30:11.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:30:11.064391172Z [2024-04-03T03:30:11.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status queued for try_number 1 2024-04-03T03:30:11.064544028Z [2024-04-03T03:30:11.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status success for try_number 1 2024-04-03T03:30:11.069956364Z [2024-04-03T03:30:11.069+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb0eae1f-7985-4dac-a4ea-760bc72fd654 2024-04-03T03:30:11.071963891Z [2024-04-03T03:30:11.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:25:00+00:00, map_index=0, run_start_date=2024-04-03 03:30:09.232962+00:00, run_end_date=2024-04-03 03:30:10.497697+00:00, run_duration=1.264735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:30:07.511190+00:00, queued_by_job_id=1, pid=9660 2024-04-03T03:30:13.704402481Z [2024-04-03T03:30:13.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:30:13.705055635Z [2024-04-03T03:30:13.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:25:00+00:00, run_id=scheduled__2024-04-03T03:25:00+00:00, run_start_date=2024-04-03 03:30:00.591186+00:00, run_end_date=2024-04-03 03:30:13.704531+00:00, run_duration=13.113345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:25:00+00:00, data_interval_end=2024-04-03 03:30:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:30:13.714643621Z [2024-04-03T03:30:13.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:30:00+00:00, run_after=2024-04-03T03:35:00+00:00 2024-04-03T03:30:13.759524505Z [2024-04-03T03:30:13.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:25:00+00:00 exited with status success for try_number 1 2024-04-03T03:30:13.770064716Z [2024-04-03T03:30:13.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:25:00+00:00, map_index=-1, run_start_date=2024-04-03 03:30:12.800610+00:00, run_end_date=2024-04-03 03:30:13.309109+00:00, run_duration=0.508499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:30:11.012218+00:00, queued_by_job_id=1, pid=9681 2024-04-03T03:31:00.905381368Z [2024-04-03T03:31:00.904+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:31:00.917442447Z [2024-04-03T03:31:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:31:00+00:00, run_after=2024-04-03T03:32:00+00:00 2024-04-03T03:31:00.970695698Z [2024-04-03T03:31:00.970+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:31:00.970719583Z 2024-04-03T03:31:00.970723094Z 2024-04-03T03:31:00.971004626Z [2024-04-03T03:31:00.970+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:31:00.971216462Z [2024-04-03T03:31:00.971+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:31:00.971809186Z [2024-04-03T03:31:00.971+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:31:00.971820180Z 2024-04-03T03:31:00.971823489Z 2024-04-03T03:31:00.974407910Z [2024-04-03T03:31:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:31:00.974797432Z [2024-04-03T03:31:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:31:00.975112448Z [2024-04-03T03:31:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:31:00.975311546Z [2024-04-03T03:31:00.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:31:01.198203711Z [2024-04-03T03:31:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status queued for try_number 1 2024-04-03T03:31:01.198369927Z [2024-04-03T03:31:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status queued for try_number 1 2024-04-03T03:31:01.205887962Z [2024-04-03T03:31:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to e43c8192-05df-4a57-8fd6-bba77308375c 2024-04-03T03:31:01.206159318Z [2024-04-03T03:31:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ad5cbe4-660f-47c8-a6a6-0338aa4a4224 2024-04-03T03:31:06.765971260Z [2024-04-03T03:31:06.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:31:06.766186047Z [2024-04-03T03:31:06.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:30:00+00:00, run_id=scheduled__2024-04-03T03:30:00+00:00, run_start_date=2024-04-03 03:31:00.930192+00:00, run_end_date=2024-04-03 03:31:06.765854+00:00, run_duration=5.835662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:30:00+00:00, data_interval_end=2024-04-03 03:31:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:31:06.778105748Z [2024-04-03T03:31:06.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:31:00+00:00, run_after=2024-04-03T03:32:00+00:00 2024-04-03T03:31:06.785585683Z [2024-04-03T03:31:06.785+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:31:06.785781625Z [2024-04-03T03:31:06.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:30:00+00:00, run_id=scheduled__2024-04-03T03:30:00+00:00, run_start_date=2024-04-03 03:31:00.928972+00:00, run_end_date=2024-04-03 03:31:06.785498+00:00, run_duration=5.856526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:30:00+00:00, data_interval_end=2024-04-03 03:31:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:31:06.795626946Z [2024-04-03T03:31:06.795+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:31:00+00:00, run_after=2024-04-03T03:32:00+00:00 2024-04-03T03:31:06.823893835Z [2024-04-03T03:31:06.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status success for try_number 1 2024-04-03T03:31:06.823947443Z [2024-04-03T03:31:06.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status success for try_number 1 2024-04-03T03:31:06.829694841Z [2024-04-03T03:31:06.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:30:00+00:00, map_index=-1, run_start_date=2024-04-03 03:31:02.943563+00:00, run_end_date=2024-04-03 03:31:06.164143+00:00, run_duration=3.22058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:31:00.972359+00:00, queued_by_job_id=1, pid=9716 2024-04-03T03:31:06.829864680Z [2024-04-03T03:31:06.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:30:00+00:00, map_index=-1, run_start_date=2024-04-03 03:31:03.125476+00:00, run_end_date=2024-04-03 03:31:06.199073+00:00, run_duration=3.073597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:31:00.972359+00:00, queued_by_job_id=1, pid=9717 2024-04-03T03:31:36.173103840Z [2024-04-03T03:31:36.171+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:32:00.190866267Z [2024-04-03T03:32:00.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:32:00+00:00, run_after=2024-04-03T03:33:00+00:00 2024-04-03T03:32:00.198628353Z [2024-04-03T03:32:00.197+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:32:00.206521504Z [2024-04-03T03:32:00.206+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:32:00.266733775Z [2024-04-03T03:32:00.266+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:32:00.266765376Z 2024-04-03T03:32:00.266769901Z 2024-04-03T03:32:00.266773600Z 2024-04-03T03:32:00.266857715Z [2024-04-03T03:32:00.266+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:32:00.267011481Z [2024-04-03T03:32:00.266+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:32:00.267123624Z [2024-04-03T03:32:00.266+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:32:00.267769748Z [2024-04-03T03:32:00.267+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:32:00.267782016Z 2024-04-03T03:32:00.267785991Z 2024-04-03T03:32:00.267789288Z 2024-04-03T03:32:00.271134436Z [2024-04-03T03:32:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:32:00.271289747Z [2024-04-03T03:32:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:32:00.271568655Z [2024-04-03T03:32:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:32:00.271708524Z [2024-04-03T03:32:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:32:00.271953287Z [2024-04-03T03:32:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:32:00.272084691Z [2024-04-03T03:32:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:32:00.615925574Z [2024-04-03T03:32:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status queued for try_number 1 2024-04-03T03:32:00.616027227Z [2024-04-03T03:32:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:31:00+00:00 exited with status queued for try_number 1 2024-04-03T03:32:00.616145134Z [2024-04-03T03:32:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:31:00+00:00 exited with status queued for try_number 1 2024-04-03T03:32:00.635522689Z [2024-04-03T03:32:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 086ab0c9-063f-48b1-bb37-e6f4ddd46754 2024-04-03T03:32:00.637426420Z [2024-04-03T03:32:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13a2e724-2b73-40f9-8b0b-c65df898c237 2024-04-03T03:32:00.637636827Z [2024-04-03T03:32:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5a75a73-5735-4113-ae5c-e7a806601556 2024-04-03T03:32:03.011119868Z [2024-04-03T03:32:03.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:32:03.011700846Z [2024-04-03T03:32:03.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:30:00+00:00, run_id=scheduled__2024-04-03T03:30:00+00:00, run_start_date=2024-04-03 03:32:00.217991+00:00, run_end_date=2024-04-03 03:32:03.011060+00:00, run_duration=2.793069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:30:00+00:00, data_interval_end=2024-04-03 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:32:03.020686355Z [2024-04-03T03:32:03.020+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:32:00+00:00, run_after=2024-04-03T03:34:00+00:00 2024-04-03T03:32:03.063882611Z [2024-04-03T03:32:03.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status success for try_number 1 2024-04-03T03:32:03.070188537Z [2024-04-03T03:32:03.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:30:00+00:00, map_index=-1, run_start_date=2024-04-03 03:32:01.498360+00:00, run_end_date=2024-04-03 03:32:01.959271+00:00, run_duration=0.460911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:32:00.268449+00:00, queued_by_job_id=1, pid=9752 2024-04-03T03:32:04.254255232Z [2024-04-03T03:32:04.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:32:04.255275759Z [2024-04-03T03:32:04.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:31:00+00:00, run_id=scheduled__2024-04-03T03:31:00+00:00, run_start_date=2024-04-03 03:32:00.219227+00:00, run_end_date=2024-04-03 03:32:04.254166+00:00, run_duration=4.034939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:31:00+00:00, data_interval_end=2024-04-03 03:32:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:32:04.266619752Z [2024-04-03T03:32:04.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:32:00+00:00, run_after=2024-04-03T03:33:00+00:00 2024-04-03T03:32:04.306193755Z [2024-04-03T03:32:04.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:31:00+00:00 exited with status success for try_number 1 2024-04-03T03:32:04.312586173Z [2024-04-03T03:32:04.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:31:00+00:00, map_index=-1, run_start_date=2024-04-03 03:32:02.498663+00:00, run_end_date=2024-04-03 03:32:03.958369+00:00, run_duration=1.459706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:32:00.268449+00:00, queued_by_job_id=1, pid=9782 2024-04-03T03:32:05.350677208Z [2024-04-03T03:32:05.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:32:05.351066096Z [2024-04-03T03:32:05.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:31:00+00:00, run_id=scheduled__2024-04-03T03:31:00+00:00, run_start_date=2024-04-03 03:32:00.220297+00:00, run_end_date=2024-04-03 03:32:05.350537+00:00, run_duration=5.13024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:31:00+00:00, data_interval_end=2024-04-03 03:32:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:32:05.360034089Z [2024-04-03T03:32:05.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:32:00+00:00, run_after=2024-04-03T03:33:00+00:00 2024-04-03T03:32:05.391163430Z [2024-04-03T03:32:05.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:31:00+00:00 exited with status success for try_number 1 2024-04-03T03:32:05.396453932Z [2024-04-03T03:32:05.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:31:00+00:00, map_index=-1, run_start_date=2024-04-03 03:32:02.659719+00:00, run_end_date=2024-04-03 03:32:05.010964+00:00, run_duration=2.351245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:32:00.268449+00:00, queued_by_job_id=1, pid=9783 2024-04-03T03:33:00.537004655Z [2024-04-03T03:33:00.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:33:00+00:00, run_after=2024-04-03T03:34:00+00:00 2024-04-03T03:33:00.544125418Z [2024-04-03T03:33:00.543+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:33:00.592032795Z [2024-04-03T03:33:00.591+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:33:00.592062318Z 2024-04-03T03:33:00.592066442Z 2024-04-03T03:33:00.592386323Z [2024-04-03T03:33:00.591+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:33:00.592465794Z [2024-04-03T03:33:00.592+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:33:00.593035565Z [2024-04-03T03:33:00.592+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:33:00.593043179Z 2024-04-03T03:33:00.593046725Z 2024-04-03T03:33:00.596670224Z [2024-04-03T03:33:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:33:00.596792357Z [2024-04-03T03:33:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:33:00.597018679Z [2024-04-03T03:33:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:33:00.597074882Z [2024-04-03T03:33:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:33:00.896558330Z [2024-04-03T03:33:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:32:00+00:00 exited with status queued for try_number 1 2024-04-03T03:33:00.896632507Z [2024-04-03T03:33:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:32:00+00:00 exited with status queued for try_number 1 2024-04-03T03:33:00.905951163Z [2024-04-03T03:33:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fdb1a6b-da35-4cda-9350-6dfeb9f3a9eb 2024-04-03T03:33:00.905973494Z [2024-04-03T03:33:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36b5267d-1ab5-4242-8523-6d7fa2bce1d1 2024-04-03T03:33:05.092635388Z [2024-04-03T03:33:05.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:33:05.093261780Z [2024-04-03T03:33:05.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:32:00+00:00, run_id=scheduled__2024-04-03T03:32:00+00:00, run_start_date=2024-04-03 03:33:00.553411+00:00, run_end_date=2024-04-03 03:33:05.092557+00:00, run_duration=4.539146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:32:00+00:00, data_interval_end=2024-04-03 03:33:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:33:05.106898156Z [2024-04-03T03:33:05.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:33:00+00:00, run_after=2024-04-03T03:34:00+00:00 2024-04-03T03:33:05.164443470Z [2024-04-03T03:33:05.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:32:00+00:00 exited with status success for try_number 1 2024-04-03T03:33:05.170246997Z [2024-04-03T03:33:05.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:32:00+00:00, map_index=-1, run_start_date=2024-04-03 03:33:02.708500+00:00, run_end_date=2024-04-03 03:33:04.748175+00:00, run_duration=2.039675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:33:00.593939+00:00, queued_by_job_id=1, pid=9839 2024-04-03T03:33:06.208279772Z [2024-04-03T03:33:06.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:33:06.208325427Z [2024-04-03T03:33:06.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:32:00+00:00, run_id=scheduled__2024-04-03T03:32:00+00:00, run_start_date=2024-04-03 03:33:00.554627+00:00, run_end_date=2024-04-03 03:33:06.208002+00:00, run_duration=5.653375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:32:00+00:00, data_interval_end=2024-04-03 03:33:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:33:06.217209000Z [2024-04-03T03:33:06.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:33:00+00:00, run_after=2024-04-03T03:34:00+00:00 2024-04-03T03:33:06.244500740Z [2024-04-03T03:33:06.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:32:00+00:00 exited with status success for try_number 1 2024-04-03T03:33:06.249467672Z [2024-04-03T03:33:06.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:32:00+00:00, map_index=-1, run_start_date=2024-04-03 03:33:02.584417+00:00, run_end_date=2024-04-03 03:33:05.124047+00:00, run_duration=2.53963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:33:00.593939+00:00, queued_by_job_id=1, pid=9838 2024-04-03T03:34:00.872111331Z [2024-04-03T03:34:00.871+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:34:00.879292780Z [2024-04-03T03:34:00.879+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:34:00.894339418Z [2024-04-03T03:34:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:34:00+00:00, run_after=2024-04-03T03:35:00+00:00 2024-04-03T03:34:00.959485392Z [2024-04-03T03:34:00.959+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:34:00.959507042Z 2024-04-03T03:34:00.959512590Z 2024-04-03T03:34:00.959517357Z 2024-04-03T03:34:00.959706797Z [2024-04-03T03:34:00.959+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:34:00.959856443Z [2024-04-03T03:34:00.959+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:34:00.960041340Z [2024-04-03T03:34:00.959+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:34:00.960940471Z [2024-04-03T03:34:00.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:34:00.960951701Z 2024-04-03T03:34:00.960956854Z 2024-04-03T03:34:00.960961654Z 2024-04-03T03:34:00.964890673Z [2024-04-03T03:34:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:34:00.965059750Z [2024-04-03T03:34:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:34:00.965350713Z [2024-04-03T03:34:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:34:00.965509530Z [2024-04-03T03:34:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:34:00.965715017Z [2024-04-03T03:34:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:34:00.965847509Z [2024-04-03T03:34:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:34:01.235806858Z [2024-04-03T03:34:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:32:00+00:00 exited with status queued for try_number 1 2024-04-03T03:34:01.235910446Z [2024-04-03T03:34:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:33:00+00:00 exited with status queued for try_number 1 2024-04-03T03:34:01.236015087Z [2024-04-03T03:34:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:33:00+00:00 exited with status queued for try_number 1 2024-04-03T03:34:01.245086573Z [2024-04-03T03:34:01.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c188b72-4384-4c5c-ad9a-24c98fd12306 2024-04-03T03:34:01.245208906Z [2024-04-03T03:34:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00d79cd6-b98d-45a4-ba16-6f0314db789b 2024-04-03T03:34:01.245333938Z [2024-04-03T03:34:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bb72dc6-2290-4172-bc33-dea4d2acfc91 2024-04-03T03:34:02.458715785Z [2024-04-03T03:34:02.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:34:02.459052315Z [2024-04-03T03:34:02.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:32:00+00:00, run_id=scheduled__2024-04-03T03:32:00+00:00, run_start_date=2024-04-03 03:34:00.907098+00:00, run_end_date=2024-04-03 03:34:02.458711+00:00, run_duration=1.551613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:32:00+00:00, data_interval_end=2024-04-03 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:34:02.466029418Z [2024-04-03T03:34:02.465+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:34:00+00:00, run_after=2024-04-03T03:36:00+00:00 2024-04-03T03:34:02.507905263Z [2024-04-03T03:34:02.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:32:00+00:00 exited with status success for try_number 1 2024-04-03T03:34:02.515527404Z [2024-04-03T03:34:02.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:32:00+00:00, map_index=-1, run_start_date=2024-04-03 03:34:01.927845+00:00, run_end_date=2024-04-03 03:34:02.230225+00:00, run_duration=0.30238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:34:00.961735+00:00, queued_by_job_id=1, pid=9874 2024-04-03T03:34:05.780477755Z [2024-04-03T03:34:05.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:34:05.780714417Z [2024-04-03T03:34:05.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:33:00+00:00, run_id=scheduled__2024-04-03T03:33:00+00:00, run_start_date=2024-04-03 03:34:00.908418+00:00, run_end_date=2024-04-03 03:34:05.780376+00:00, run_duration=4.871958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:33:00+00:00, data_interval_end=2024-04-03 03:34:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:34:05.789183380Z [2024-04-03T03:34:05.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:34:00+00:00, run_after=2024-04-03T03:35:00+00:00 2024-04-03T03:34:05.795150071Z [2024-04-03T03:34:05.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:34:05.795298263Z [2024-04-03T03:34:05.795+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:33:00+00:00, run_id=scheduled__2024-04-03T03:33:00+00:00, run_start_date=2024-04-03 03:34:00.909497+00:00, run_end_date=2024-04-03 03:34:05.795048+00:00, run_duration=4.885551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:33:00+00:00, data_interval_end=2024-04-03 03:34:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:34:05.804134521Z [2024-04-03T03:34:05.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:34:00+00:00, run_after=2024-04-03T03:35:00+00:00 2024-04-03T03:34:05.834151883Z [2024-04-03T03:34:05.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:33:00+00:00 exited with status success for try_number 1 2024-04-03T03:34:05.834178337Z [2024-04-03T03:34:05.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:33:00+00:00 exited with status success for try_number 1 2024-04-03T03:34:05.840938187Z [2024-04-03T03:34:05.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:33:00+00:00, map_index=-1, run_start_date=2024-04-03 03:34:03.120417+00:00, run_end_date=2024-04-03 03:34:05.195005+00:00, run_duration=2.074588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:34:00.961735+00:00, queued_by_job_id=1, pid=9905 2024-04-03T03:34:05.841037316Z [2024-04-03T03:34:05.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:33:00+00:00, map_index=-1, run_start_date=2024-04-03 03:34:03.066156+00:00, run_end_date=2024-04-03 03:34:05.506797+00:00, run_duration=2.440641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:34:00.961735+00:00, queued_by_job_id=1, pid=9904 2024-04-03T03:35:00.217841123Z [2024-04-03T03:35:00.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:35:00+00:00, run_after=2024-04-03T03:36:00+00:00 2024-04-03T03:35:00.223580592Z [2024-04-03T03:35:00.223+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:35:00.234653831Z [2024-04-03T03:35:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:35:00+00:00, run_after=2024-04-03T03:40:00+00:00 2024-04-03T03:35:00.310356408Z [2024-04-03T03:35:00.309+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:35:00.310385769Z 2024-04-03T03:35:00.310390142Z 2024-04-03T03:35:00.310394125Z 2024-04-03T03:35:00.310397452Z [2024-04-03T03:35:00.310+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:35:00.310525548Z [2024-04-03T03:35:00.310+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:35:00.310553271Z [2024-04-03T03:35:00.310+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:35:00.311162232Z [2024-04-03T03:35:00.310+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:35:00.311175012Z 2024-04-03T03:35:00.311178983Z 2024-04-03T03:35:00.311190683Z 2024-04-03T03:35:00.314652318Z [2024-04-03T03:35:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:35:00.314779513Z [2024-04-03T03:35:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:35:00.314915756Z [2024-04-03T03:35:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:35:00.315007110Z [2024-04-03T03:35:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:35:00.315216594Z [2024-04-03T03:35:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:35:00.315300974Z [2024-04-03T03:35:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:35:00.635944102Z [2024-04-03T03:35:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status queued for try_number 1 2024-04-03T03:35:00.640168637Z [2024-04-03T03:35:00.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:34:00+00:00 exited with status queued for try_number 1 2024-04-03T03:35:00.640489808Z [2024-04-03T03:35:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:34:00+00:00 exited with status queued for try_number 1 2024-04-03T03:35:00.654570932Z [2024-04-03T03:35:00.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to f016130e-1d19-43fa-980a-1ebee8174b96 2024-04-03T03:35:00.655703798Z [2024-04-03T03:35:00.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7afe387-1914-4ac1-a6c7-3931f56ea574 2024-04-03T03:35:00.657426729Z [2024-04-03T03:35:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e4670e3-6560-4490-a534-b1ff51ba29f3 2024-04-03T03:35:04.289618680Z [2024-04-03T03:35:04.289+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:35:04.289652732Z 2024-04-03T03:35:04.289658648Z [2024-04-03T03:35:04.289+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:35:04.290496597Z [2024-04-03T03:35:04.290+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:35:04.290515057Z 2024-04-03T03:35:04.294413263Z [2024-04-03T03:35:04.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:35:04.294727844Z [2024-04-03T03:35:04.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:35:04.336940957Z [2024-04-03T03:35:04.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status queued for try_number 1 2024-04-03T03:35:04.339236361Z [2024-04-03T03:35:04.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status success for try_number 1 2024-04-03T03:35:04.347432731Z [2024-04-03T03:35:04.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6e0d3df-5a2b-44ca-b25b-85929d77c229 2024-04-03T03:35:04.347502483Z [2024-04-03T03:35:04.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:30:00+00:00, map_index=-1, run_start_date=2024-04-03 03:35:02.701929+00:00, run_end_date=2024-04-03 03:35:03.258289+00:00, run_duration=0.55636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:35:00.311724+00:00, queued_by_job_id=1, pid=9962 2024-04-03T03:35:04.390972890Z [2024-04-03T03:35:04.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:35:04.391287885Z [2024-04-03T03:35:04.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:34:00+00:00, run_id=scheduled__2024-04-03T03:34:00+00:00, run_start_date=2024-04-03 03:35:00.245119+00:00, run_end_date=2024-04-03 03:35:04.390846+00:00, run_duration=4.145727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:34:00+00:00, data_interval_end=2024-04-03 03:35:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:35:04.403052721Z [2024-04-03T03:35:04.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:35:00+00:00, run_after=2024-04-03T03:36:00+00:00 2024-04-03T03:35:04.471807208Z [2024-04-03T03:35:04.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:34:00+00:00 exited with status success for try_number 1 2024-04-03T03:35:04.487392136Z [2024-04-03T03:35:04.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:34:00+00:00, map_index=-1, run_start_date=2024-04-03 03:35:02.681924+00:00, run_end_date=2024-04-03 03:35:04.250241+00:00, run_duration=1.568317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:35:00.311724+00:00, queued_by_job_id=1, pid=9961 2024-04-03T03:35:05.542459295Z [2024-04-03T03:35:05.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:35:05.542855677Z [2024-04-03T03:35:05.542+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:34:00+00:00, run_id=scheduled__2024-04-03T03:34:00+00:00, run_start_date=2024-04-03 03:35:00.248217+00:00, run_end_date=2024-04-03 03:35:05.542306+00:00, run_duration=5.294089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:34:00+00:00, data_interval_end=2024-04-03 03:35:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:35:05.552804850Z [2024-04-03T03:35:05.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:35:00+00:00, run_after=2024-04-03T03:36:00+00:00 2024-04-03T03:35:05.615550973Z [2024-04-03T03:35:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:34:00+00:00 exited with status success for try_number 1 2024-04-03T03:35:05.621608125Z [2024-04-03T03:35:05.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:34:00+00:00, map_index=-1, run_start_date=2024-04-03 03:35:03.080148+00:00, run_end_date=2024-04-03 03:35:04.897567+00:00, run_duration=1.817419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:35:00.311724+00:00, queued_by_job_id=1, pid=9983 2024-04-03T03:35:06.870482966Z [2024-04-03T03:35:06.870+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:35:06.870514490Z 2024-04-03T03:35:06.870706353Z [2024-04-03T03:35:06.870+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:35:06.871292183Z [2024-04-03T03:35:06.871+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:35:06.871303443Z 2024-04-03T03:35:06.873585404Z [2024-04-03T03:35:06.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:35:06.873806617Z [2024-04-03T03:35:06.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:35:06.930042931Z [2024-04-03T03:35:06.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status queued for try_number 1 2024-04-03T03:35:06.931147816Z [2024-04-03T03:35:06.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status success for try_number 1 2024-04-03T03:35:06.938482159Z [2024-04-03T03:35:06.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44e66af0-6692-49a8-9424-96d8590e526e 2024-04-03T03:35:06.938784663Z [2024-04-03T03:35:06.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:30:00+00:00, map_index=-1, run_start_date=2024-04-03 03:35:05.883278+00:00, run_end_date=2024-04-03 03:35:06.234988+00:00, run_duration=0.35171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:35:04.291759+00:00, queued_by_job_id=1, pid=10010 2024-04-03T03:35:09.914097813Z [2024-04-03T03:35:09.913+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:35:09.914126142Z 2024-04-03T03:35:09.914134135Z [2024-04-03T03:35:09.913+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:35:09.914883614Z [2024-04-03T03:35:09.914+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:35:09.914897364Z 2024-04-03T03:35:09.917234253Z [2024-04-03T03:35:09.916+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:35:09.917332602Z [2024-04-03T03:35:09.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:35:09.963290879Z [2024-04-03T03:35:09.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status queued for try_number 1 2024-04-03T03:35:09.963510060Z [2024-04-03T03:35:09.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status success for try_number 1 2024-04-03T03:35:09.972461924Z [2024-04-03T03:35:09.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to fda06467-fe5a-49e6-94fe-bcdd83046bbb 2024-04-03T03:35:09.972896605Z [2024-04-03T03:35:09.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:30:00+00:00, map_index=0, run_start_date=2024-04-03 03:35:08.503581+00:00, run_end_date=2024-04-03 03:35:09.752013+00:00, run_duration=1.248432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:35:06.871712+00:00, queued_by_job_id=1, pid=10022 2024-04-03T03:35:13.019614012Z [2024-04-03T03:35:13.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:35:13.020108495Z [2024-04-03T03:35:13.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:30:00+00:00, run_id=scheduled__2024-04-03T03:30:00+00:00, run_start_date=2024-04-03 03:35:00.243852+00:00, run_end_date=2024-04-03 03:35:13.019782+00:00, run_duration=12.77593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:30:00+00:00, data_interval_end=2024-04-03 03:35:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:35:13.027914942Z [2024-04-03T03:35:13.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:35:00+00:00, run_after=2024-04-03T03:40:00+00:00 2024-04-03T03:35:13.062078088Z [2024-04-03T03:35:13.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:30:00+00:00 exited with status success for try_number 1 2024-04-03T03:35:13.070487051Z [2024-04-03T03:35:13.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:30:00+00:00, map_index=-1, run_start_date=2024-04-03 03:35:11.893009+00:00, run_end_date=2024-04-03 03:35:12.311394+00:00, run_duration=0.418385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:35:09.915205+00:00, queued_by_job_id=1, pid=10043 2024-04-03T03:36:00.707646643Z [2024-04-03T03:36:00.707+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:36:00.717402760Z [2024-04-03T03:36:00.717+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:36:00.731797657Z [2024-04-03T03:36:00.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:36:00+00:00, run_after=2024-04-03T03:37:00+00:00 2024-04-03T03:36:00.815886189Z [2024-04-03T03:36:00.815+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:36:00.815904353Z 2024-04-03T03:36:00.815908568Z 2024-04-03T03:36:00.815912044Z 2024-04-03T03:36:00.815965134Z [2024-04-03T03:36:00.815+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:36:00.815969056Z [2024-04-03T03:36:00.815+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:36:00.815972150Z [2024-04-03T03:36:00.815+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:36:00.816484347Z [2024-04-03T03:36:00.816+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:36:00.816494980Z 2024-04-03T03:36:00.816499288Z 2024-04-03T03:36:00.816502570Z 2024-04-03T03:36:00.820624445Z [2024-04-03T03:36:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:36:00.820840804Z [2024-04-03T03:36:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:36:00.821257271Z [2024-04-03T03:36:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:36:00.821337379Z [2024-04-03T03:36:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:36:00.821492604Z [2024-04-03T03:36:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:36:00.821569096Z [2024-04-03T03:36:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:36:01.257852699Z [2024-04-03T03:36:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:34:00+00:00 exited with status queued for try_number 1 2024-04-03T03:36:01.257966597Z [2024-04-03T03:36:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status queued for try_number 1 2024-04-03T03:36:01.258067558Z [2024-04-03T03:36:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status queued for try_number 1 2024-04-03T03:36:01.268033250Z [2024-04-03T03:36:01.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to 595f9133-4c92-4d28-9a74-69b46a6f18d9 2024-04-03T03:36:01.268223445Z [2024-04-03T03:36:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b218a4c-1c5e-423e-871b-e0deaf441339 2024-04-03T03:36:01.268371411Z [2024-04-03T03:36:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to cccb57ba-cdcd-4db8-95e4-acaebb1f1b1e 2024-04-03T03:36:02.858353303Z [2024-04-03T03:36:02.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:36:02.858815160Z [2024-04-03T03:36:02.858+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:34:00+00:00, run_id=scheduled__2024-04-03T03:34:00+00:00, run_start_date=2024-04-03 03:36:00.743257+00:00, run_end_date=2024-04-03 03:36:02.858282+00:00, run_duration=2.115025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:34:00+00:00, data_interval_end=2024-04-03 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:36:02.867295643Z [2024-04-03T03:36:02.867+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:36:00+00:00, run_after=2024-04-03T03:38:00+00:00 2024-04-03T03:36:02.951396963Z [2024-04-03T03:36:02.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:34:00+00:00 exited with status success for try_number 1 2024-04-03T03:36:02.961423542Z [2024-04-03T03:36:02.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:34:00+00:00, map_index=-1, run_start_date=2024-04-03 03:36:01.983758+00:00, run_end_date=2024-04-03 03:36:02.334209+00:00, run_duration=0.350451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:36:00.817291+00:00, queued_by_job_id=1, pid=10061 2024-04-03T03:36:05.107444105Z [2024-04-03T03:36:05.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:36:05.107897952Z [2024-04-03T03:36:05.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:35:00+00:00, run_id=scheduled__2024-04-03T03:35:00+00:00, run_start_date=2024-04-03 03:36:00.747377+00:00, run_end_date=2024-04-03 03:36:05.107536+00:00, run_duration=4.360159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:35:00+00:00, data_interval_end=2024-04-03 03:36:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:36:05.119618736Z [2024-04-03T03:36:05.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:36:00+00:00, run_after=2024-04-03T03:37:00+00:00 2024-04-03T03:36:05.157903338Z [2024-04-03T03:36:05.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status success for try_number 1 2024-04-03T03:36:05.164919595Z [2024-04-03T03:36:05.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:35:00+00:00, map_index=-1, run_start_date=2024-04-03 03:36:03.247433+00:00, run_end_date=2024-04-03 03:36:04.981375+00:00, run_duration=1.733942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:36:00.817291+00:00, queued_by_job_id=1, pid=10092 2024-04-03T03:36:06.212056004Z [2024-04-03T03:36:06.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:36:06.212664223Z [2024-04-03T03:36:06.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:35:00+00:00, run_id=scheduled__2024-04-03T03:35:00+00:00, run_start_date=2024-04-03 03:36:00.752214+00:00, run_end_date=2024-04-03 03:36:06.212171+00:00, run_duration=5.459957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:35:00+00:00, data_interval_end=2024-04-03 03:36:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:36:06.226835924Z [2024-04-03T03:36:06.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:36:00+00:00, run_after=2024-04-03T03:37:00+00:00 2024-04-03T03:36:06.267962743Z [2024-04-03T03:36:06.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status success for try_number 1 2024-04-03T03:36:06.274126356Z [2024-04-03T03:36:06.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:35:00+00:00, map_index=-1, run_start_date=2024-04-03 03:36:03.228081+00:00, run_end_date=2024-04-03 03:36:05.508747+00:00, run_duration=2.280666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:36:00.817291+00:00, queued_by_job_id=1, pid=10091 2024-04-03T03:36:36.229112954Z [2024-04-03T03:36:36.228+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:37:00.706951565Z [2024-04-03T03:37:00.705+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:37:00.746987882Z [2024-04-03T03:37:00.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:37:00+00:00, run_after=2024-04-03T03:38:00+00:00 2024-04-03T03:37:00.854714465Z [2024-04-03T03:37:00.852+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:37:00.854745004Z 2024-04-03T03:37:00.854748914Z 2024-04-03T03:37:00.854752147Z [2024-04-03T03:37:00.853+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:37:00.854755295Z [2024-04-03T03:37:00.853+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:37:00.854773937Z [2024-04-03T03:37:00.854+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:37:00.854777779Z 2024-04-03T03:37:00.854780975Z 2024-04-03T03:37:00.859386613Z [2024-04-03T03:37:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:37:00.859724023Z [2024-04-03T03:37:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:37:00.862928531Z [2024-04-03T03:37:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:37:00.862987967Z [2024-04-03T03:37:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:37:01.295903918Z [2024-04-03T03:37:01.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:36:00+00:00 exited with status queued for try_number 1 2024-04-03T03:37:01.297597609Z [2024-04-03T03:37:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:36:00+00:00 exited with status queued for try_number 1 2024-04-03T03:37:01.315391024Z [2024-04-03T03:37:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2610b295-d579-4c5c-9360-7c152dc9c4b3 2024-04-03T03:37:01.315559061Z [2024-04-03T03:37:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac23776e-ea25-4a0b-8ee2-2b57b4461ead 2024-04-03T03:37:07.010102654Z [2024-04-03T03:37:07.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:37:07.011560521Z [2024-04-03T03:37:07.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:36:00+00:00, run_id=scheduled__2024-04-03T03:36:00+00:00, run_start_date=2024-04-03 03:37:00.784035+00:00, run_end_date=2024-04-03 03:37:07.010717+00:00, run_duration=6.226682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:36:00+00:00, data_interval_end=2024-04-03 03:37:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:37:07.025564307Z [2024-04-03T03:37:07.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:37:00+00:00, run_after=2024-04-03T03:38:00+00:00 2024-04-03T03:37:07.034915570Z [2024-04-03T03:37:07.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:37:07.035154224Z [2024-04-03T03:37:07.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:36:00+00:00, run_id=scheduled__2024-04-03T03:36:00+00:00, run_start_date=2024-04-03 03:37:00.769311+00:00, run_end_date=2024-04-03 03:37:07.034814+00:00, run_duration=6.265503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:36:00+00:00, data_interval_end=2024-04-03 03:37:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:37:07.047034673Z [2024-04-03T03:37:07.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:37:00+00:00, run_after=2024-04-03T03:38:00+00:00 2024-04-03T03:37:07.087497923Z [2024-04-03T03:37:07.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:36:00+00:00 exited with status success for try_number 1 2024-04-03T03:37:07.087638330Z [2024-04-03T03:37:07.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:36:00+00:00 exited with status success for try_number 1 2024-04-03T03:37:07.093711865Z [2024-04-03T03:37:07.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:36:00+00:00, map_index=-1, run_start_date=2024-04-03 03:37:03.434991+00:00, run_end_date=2024-04-03 03:37:06.450963+00:00, run_duration=3.015972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:37:00.855307+00:00, queued_by_job_id=1, pid=10147 2024-04-03T03:37:07.093867396Z [2024-04-03T03:37:07.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:36:00+00:00, map_index=-1, run_start_date=2024-04-03 03:37:03.434732+00:00, run_end_date=2024-04-03 03:37:06.447186+00:00, run_duration=3.012454, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:37:00.855307+00:00, queued_by_job_id=1, pid=10146 2024-04-03T03:38:00.496415853Z [2024-04-03T03:38:00.495+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:38:00.508971949Z [2024-04-03T03:38:00.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:38:00+00:00, run_after=2024-04-03T03:39:00+00:00 2024-04-03T03:38:00.515357881Z [2024-04-03T03:38:00.515+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:38:00.575121660Z [2024-04-03T03:38:00.574+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:38:00.575169970Z 2024-04-03T03:38:00.575174188Z 2024-04-03T03:38:00.575177336Z 2024-04-03T03:38:00.575188545Z [2024-04-03T03:38:00.575+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:38:00.575343994Z [2024-04-03T03:38:00.575+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:38:00.575478415Z [2024-04-03T03:38:00.575+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:38:00.576007662Z [2024-04-03T03:38:00.575+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:38:00.576015292Z 2024-04-03T03:38:00.576018563Z 2024-04-03T03:38:00.576021457Z 2024-04-03T03:38:00.579168461Z [2024-04-03T03:38:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:38:00.579340165Z [2024-04-03T03:38:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:38:00.579590060Z [2024-04-03T03:38:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:38:00.579634747Z [2024-04-03T03:38:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:38:00.579840262Z [2024-04-03T03:38:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:38:00.579906203Z [2024-04-03T03:38:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:38:01.073951992Z [2024-04-03T03:38:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:36:00+00:00 exited with status queued for try_number 1 2024-04-03T03:38:01.074307945Z [2024-04-03T03:38:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:37:00+00:00 exited with status queued for try_number 1 2024-04-03T03:38:01.074541000Z [2024-04-03T03:38:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:37:00+00:00 exited with status queued for try_number 1 2024-04-03T03:38:01.090492757Z [2024-04-03T03:38:01.090+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2be341ae-f2e8-44f5-83a2-1371f24a1c19 2024-04-03T03:38:01.090984747Z [2024-04-03T03:38:01.090+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ee38488-5e20-4190-b30d-c7a695f538fb 2024-04-03T03:38:01.091940411Z [2024-04-03T03:38:01.091+0000] {scheduler_job.py:635} INFO - Setting external_id for to c67a8fd4-3236-4406-b45b-515cf8ce773e 2024-04-03T03:38:03.400123120Z [2024-04-03T03:38:03.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:38:03.403887129Z [2024-04-03T03:38:03.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:36:00+00:00, run_id=scheduled__2024-04-03T03:36:00+00:00, run_start_date=2024-04-03 03:38:00.524849+00:00, run_end_date=2024-04-03 03:38:03.400044+00:00, run_duration=2.875195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:36:00+00:00, data_interval_end=2024-04-03 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:38:03.429057272Z [2024-04-03T03:38:03.428+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:38:00+00:00, run_after=2024-04-03T03:40:00+00:00 2024-04-03T03:38:03.501642728Z [2024-04-03T03:38:03.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:36:00+00:00 exited with status success for try_number 1 2024-04-03T03:38:03.511405263Z [2024-04-03T03:38:03.511+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:36:00+00:00, map_index=-1, run_start_date=2024-04-03 03:38:02.212535+00:00, run_end_date=2024-04-03 03:38:02.762241+00:00, run_duration=0.549706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:38:00.576637+00:00, queued_by_job_id=1, pid=10183 2024-04-03T03:38:06.797160175Z [2024-04-03T03:38:06.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:38:06.797507793Z [2024-04-03T03:38:06.797+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:37:00+00:00, run_id=scheduled__2024-04-03T03:37:00+00:00, run_start_date=2024-04-03 03:38:00.527142+00:00, run_end_date=2024-04-03 03:38:06.797052+00:00, run_duration=6.26991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:37:00+00:00, data_interval_end=2024-04-03 03:38:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:38:06.811796409Z [2024-04-03T03:38:06.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:38:00+00:00, run_after=2024-04-03T03:39:00+00:00 2024-04-03T03:38:06.820342012Z [2024-04-03T03:38:06.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:38:06.820506071Z [2024-04-03T03:38:06.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:37:00+00:00, run_id=scheduled__2024-04-03T03:37:00+00:00, run_start_date=2024-04-03 03:38:00.526051+00:00, run_end_date=2024-04-03 03:38:06.820223+00:00, run_duration=6.294172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:37:00+00:00, data_interval_end=2024-04-03 03:38:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:38:06.830466564Z [2024-04-03T03:38:06.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:38:00+00:00, run_after=2024-04-03T03:39:00+00:00 2024-04-03T03:38:06.860908068Z [2024-04-03T03:38:06.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:37:00+00:00 exited with status success for try_number 1 2024-04-03T03:38:06.860938600Z [2024-04-03T03:38:06.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:37:00+00:00 exited with status success for try_number 1 2024-04-03T03:38:06.868226606Z [2024-04-03T03:38:06.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:37:00+00:00, map_index=-1, run_start_date=2024-04-03 03:38:04.088748+00:00, run_end_date=2024-04-03 03:38:05.991618+00:00, run_duration=1.90287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:38:00.576637+00:00, queued_by_job_id=1, pid=10222 2024-04-03T03:38:06.868294634Z [2024-04-03T03:38:06.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:37:00+00:00, map_index=-1, run_start_date=2024-04-03 03:38:03.585574+00:00, run_end_date=2024-04-03 03:38:06.314553+00:00, run_duration=2.728979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:38:00.576637+00:00, queued_by_job_id=1, pid=10203 2024-04-03T03:39:00.397897356Z [2024-04-03T03:39:00.397+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:39:00.416322268Z [2024-04-03T03:39:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:39:00+00:00, run_after=2024-04-03T03:40:00+00:00 2024-04-03T03:39:00.463135221Z [2024-04-03T03:39:00.462+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:39:00.463166789Z 2024-04-03T03:39:00.463183482Z 2024-04-03T03:39:00.463193211Z [2024-04-03T03:39:00.463+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:39:00.463264836Z [2024-04-03T03:39:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:39:00.463739036Z [2024-04-03T03:39:00.463+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:39:00.463745372Z 2024-04-03T03:39:00.463748216Z 2024-04-03T03:39:00.466288527Z [2024-04-03T03:39:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:39:00.466377261Z [2024-04-03T03:39:00.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:39:00.466560078Z [2024-04-03T03:39:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:39:00.466696025Z [2024-04-03T03:39:00.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:39:00.649290593Z [2024-04-03T03:39:00.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:38:00+00:00 exited with status queued for try_number 1 2024-04-03T03:39:00.649321209Z [2024-04-03T03:39:00.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:38:00+00:00 exited with status queued for try_number 1 2024-04-03T03:39:00.663361490Z [2024-04-03T03:39:00.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2545ce4c-0a6b-4d9e-bc5c-0566787ae3d6 2024-04-03T03:39:00.663993735Z [2024-04-03T03:39:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to b18cea5e-abb3-4dd1-bb0c-35f4025e2415 2024-04-03T03:39:03.855231173Z [2024-04-03T03:39:03.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:39:03.855560321Z [2024-04-03T03:39:03.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:38:00+00:00, run_id=scheduled__2024-04-03T03:38:00+00:00, run_start_date=2024-04-03 03:39:00.425592+00:00, run_end_date=2024-04-03 03:39:03.855178+00:00, run_duration=3.429586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:38:00+00:00, data_interval_end=2024-04-03 03:39:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:39:03.866118588Z [2024-04-03T03:39:03.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:39:00+00:00, run_after=2024-04-03T03:40:00+00:00 2024-04-03T03:39:03.897497478Z [2024-04-03T03:39:03.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:38:00+00:00 exited with status success for try_number 1 2024-04-03T03:39:03.902698360Z [2024-04-03T03:39:03.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:38:00+00:00, map_index=-1, run_start_date=2024-04-03 03:39:02.459306+00:00, run_end_date=2024-04-03 03:39:03.708424+00:00, run_duration=1.249118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:39:00.464131+00:00, queued_by_job_id=1, pid=10258 2024-04-03T03:39:05.489228307Z [2024-04-03T03:39:05.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:39:05.489666229Z [2024-04-03T03:39:05.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:38:00+00:00, run_id=scheduled__2024-04-03T03:38:00+00:00, run_start_date=2024-04-03 03:39:00.426905+00:00, run_end_date=2024-04-03 03:39:05.489167+00:00, run_duration=5.062262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:38:00+00:00, data_interval_end=2024-04-03 03:39:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:39:05.500119854Z [2024-04-03T03:39:05.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:39:00+00:00, run_after=2024-04-03T03:40:00+00:00 2024-04-03T03:39:05.528056038Z [2024-04-03T03:39:05.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:38:00+00:00 exited with status success for try_number 1 2024-04-03T03:39:05.533157746Z [2024-04-03T03:39:05.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:38:00+00:00, map_index=-1, run_start_date=2024-04-03 03:39:02.868761+00:00, run_end_date=2024-04-03 03:39:04.520389+00:00, run_duration=1.651628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:39:00.464131+00:00, queued_by_job_id=1, pid=10277 2024-04-03T03:40:00.080987601Z [2024-04-03T03:40:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:40:00+00:00, run_after=2024-04-03T03:41:00+00:00 2024-04-03T03:40:00.089716417Z [2024-04-03T03:40:00.089+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:40:00.100705854Z [2024-04-03T03:40:00.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:40:00+00:00, run_after=2024-04-03T03:45:00+00:00 2024-04-03T03:40:00.106691996Z [2024-04-03T03:40:00.106+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:40:00.213517539Z [2024-04-03T03:40:00.211+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T03:40:00.213551369Z 2024-04-03T03:40:00.213555102Z 2024-04-03T03:40:00.213558950Z 2024-04-03T03:40:00.213562873Z 2024-04-03T03:40:00.213566345Z [2024-04-03T03:40:00.211+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:40:00.213570121Z [2024-04-03T03:40:00.212+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:40:00.213573337Z [2024-04-03T03:40:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:40:00.213576375Z [2024-04-03T03:40:00.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:40:00.213579410Z [2024-04-03T03:40:00.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:40:00.213582561Z 2024-04-03T03:40:00.213585574Z 2024-04-03T03:40:00.213588606Z 2024-04-03T03:40:00.213591799Z 2024-04-03T03:40:00.220539398Z [2024-04-03T03:40:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:40:00.220564380Z [2024-04-03T03:40:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:40:00.220571454Z [2024-04-03T03:40:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:40:00.220584084Z [2024-04-03T03:40:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:40:00.220605744Z [2024-04-03T03:40:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:40:00.220612062Z [2024-04-03T03:40:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:40:00.221789178Z [2024-04-03T03:40:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:40:00.221817131Z [2024-04-03T03:40:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:40:00.804864057Z [2024-04-03T03:40:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status queued for try_number 1 2024-04-03T03:40:00.804884986Z [2024-04-03T03:40:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:38:00+00:00 exited with status queued for try_number 1 2024-04-03T03:40:00.804889328Z [2024-04-03T03:40:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:39:00+00:00 exited with status queued for try_number 1 2024-04-03T03:40:00.804892919Z [2024-04-03T03:40:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:39:00+00:00 exited with status queued for try_number 1 2024-04-03T03:40:00.804896204Z [2024-04-03T03:40:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to f808a57c-9b1e-4c3d-9309-cf4deb6faf8e 2024-04-03T03:40:00.804899830Z [2024-04-03T03:40:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to a285aa18-415d-4f4a-9988-7ebb8c007486 2024-04-03T03:40:00.804902943Z [2024-04-03T03:40:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48c6c290-0905-4513-8b3b-2801dda1114e 2024-04-03T03:40:00.804905988Z [2024-04-03T03:40:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01a35bd3-cd6d-4174-9780-e66bc7073cf2 2024-04-03T03:40:02.126837847Z [2024-04-03T03:40:02.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:40:02.127136053Z [2024-04-03T03:40:02.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:38:00+00:00, run_id=scheduled__2024-04-03T03:38:00+00:00, run_start_date=2024-04-03 03:40:00.118063+00:00, run_end_date=2024-04-03 03:40:02.126743+00:00, run_duration=2.00868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:38:00+00:00, data_interval_end=2024-04-03 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:40:02.142100894Z [2024-04-03T03:40:02.141+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:40:00+00:00, run_after=2024-04-03T03:42:00+00:00 2024-04-03T03:40:02.196068886Z [2024-04-03T03:40:02.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:38:00+00:00 exited with status success for try_number 1 2024-04-03T03:40:02.202098655Z [2024-04-03T03:40:02.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:38:00+00:00, map_index=-1, run_start_date=2024-04-03 03:40:01.549140+00:00, run_end_date=2024-04-03 03:40:01.983905+00:00, run_duration=0.434765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:40:00.214390+00:00, queued_by_job_id=1, pid=10305 2024-04-03T03:40:04.350982135Z [2024-04-03T03:40:04.350+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:40:04.351006942Z 2024-04-03T03:40:04.351018215Z [2024-04-03T03:40:04.350+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:40:04.351512463Z [2024-04-03T03:40:04.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:40:04.351521969Z 2024-04-03T03:40:04.353874669Z [2024-04-03T03:40:04.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:40:04.353942899Z [2024-04-03T03:40:04.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:40:04.395498041Z [2024-04-03T03:40:04.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status queued for try_number 1 2024-04-03T03:40:04.395992819Z [2024-04-03T03:40:04.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status success for try_number 1 2024-04-03T03:40:04.404395431Z [2024-04-03T03:40:04.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 372b1de0-053c-4852-b9f6-27f03217d211 2024-04-03T03:40:04.404848966Z [2024-04-03T03:40:04.404+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:35:00+00:00, map_index=-1, run_start_date=2024-04-03 03:40:03.700900+00:00, run_end_date=2024-04-03 03:40:04.123632+00:00, run_duration=0.422732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:40:00.214390+00:00, queued_by_job_id=1, pid=10365 2024-04-03T03:40:05.577148539Z [2024-04-03T03:40:05.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:40:05.578169600Z [2024-04-03T03:40:05.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:39:00+00:00, run_id=scheduled__2024-04-03T03:39:00+00:00, run_start_date=2024-04-03 03:40:00.119145+00:00, run_end_date=2024-04-03 03:40:05.577028+00:00, run_duration=5.457883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:39:00+00:00, data_interval_end=2024-04-03 03:40:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:40:05.587620510Z [2024-04-03T03:40:05.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:40:00+00:00, run_after=2024-04-03T03:41:00+00:00 2024-04-03T03:40:05.594805888Z [2024-04-03T03:40:05.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:40:05.595123807Z [2024-04-03T03:40:05.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:39:00+00:00, run_id=scheduled__2024-04-03T03:39:00+00:00, run_start_date=2024-04-03 03:40:00.120273+00:00, run_end_date=2024-04-03 03:40:05.594720+00:00, run_duration=5.474447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:39:00+00:00, data_interval_end=2024-04-03 03:40:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:40:05.606356665Z [2024-04-03T03:40:05.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:40:00+00:00, run_after=2024-04-03T03:41:00+00:00 2024-04-03T03:40:05.647727179Z [2024-04-03T03:40:05.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:39:00+00:00 exited with status success for try_number 1 2024-04-03T03:40:05.647753798Z [2024-04-03T03:40:05.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:39:00+00:00 exited with status success for try_number 1 2024-04-03T03:40:05.653643118Z [2024-04-03T03:40:05.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:39:00+00:00, map_index=-1, run_start_date=2024-04-03 03:40:03.401141+00:00, run_end_date=2024-04-03 03:40:05.251951+00:00, run_duration=1.85081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:40:00.214390+00:00, queued_by_job_id=1, pid=10355 2024-04-03T03:40:05.653755530Z [2024-04-03T03:40:05.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:39:00+00:00, map_index=-1, run_start_date=2024-04-03 03:40:02.908443+00:00, run_end_date=2024-04-03 03:40:05.105700+00:00, run_duration=2.197257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:40:00.214390+00:00, queued_by_job_id=1, pid=10327 2024-04-03T03:40:06.975433513Z [2024-04-03T03:40:06.975+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:40:06.975459767Z 2024-04-03T03:40:06.975463460Z [2024-04-03T03:40:06.975+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:40:06.976262177Z [2024-04-03T03:40:06.976+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:40:06.976277050Z 2024-04-03T03:40:06.978440714Z [2024-04-03T03:40:06.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:40:06.978454503Z [2024-04-03T03:40:06.978+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:40:07.026719648Z [2024-04-03T03:40:07.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status queued for try_number 1 2024-04-03T03:40:07.026763068Z [2024-04-03T03:40:07.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status success for try_number 1 2024-04-03T03:40:07.033595958Z [2024-04-03T03:40:07.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to dec13626-a5d0-43d4-9700-59f5035c0d4a 2024-04-03T03:40:07.033861386Z [2024-04-03T03:40:07.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:35:00+00:00, map_index=-1, run_start_date=2024-04-03 03:40:06.069546+00:00, run_end_date=2024-04-03 03:40:06.391323+00:00, run_duration=0.321777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:40:04.351795+00:00, queued_by_job_id=1, pid=10386 2024-04-03T03:40:10.382113699Z [2024-04-03T03:40:10.381+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:40:10.382143158Z 2024-04-03T03:40:10.382666984Z [2024-04-03T03:40:10.381+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:40:10.385014146Z [2024-04-03T03:40:10.384+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:40:10.385030637Z 2024-04-03T03:40:10.389293426Z [2024-04-03T03:40:10.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:40:10.389586277Z [2024-04-03T03:40:10.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:40:10.469447448Z [2024-04-03T03:40:10.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status queued for try_number 1 2024-04-03T03:40:10.469488640Z [2024-04-03T03:40:10.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status success for try_number 1 2024-04-03T03:40:10.480603034Z [2024-04-03T03:40:10.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 127048ac-9b3a-487e-ba44-0f01fcda604b 2024-04-03T03:40:10.480775852Z [2024-04-03T03:40:10.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:35:00+00:00, map_index=0, run_start_date=2024-04-03 03:40:08.727131+00:00, run_end_date=2024-04-03 03:40:09.993957+00:00, run_duration=1.266826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:40:06.976519+00:00, queued_by_job_id=1, pid=10398 2024-04-03T03:40:13.412471736Z [2024-04-03T03:40:13.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:40:13.419266077Z [2024-04-03T03:40:13.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:35:00+00:00, run_id=scheduled__2024-04-03T03:35:00+00:00, run_start_date=2024-04-03 03:40:00.116913+00:00, run_end_date=2024-04-03 03:40:13.412382+00:00, run_duration=13.295469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:35:00+00:00, data_interval_end=2024-04-03 03:40:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:40:13.440981126Z [2024-04-03T03:40:13.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:40:00+00:00, run_after=2024-04-03T03:45:00+00:00 2024-04-03T03:40:13.474214867Z [2024-04-03T03:40:13.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:35:00+00:00 exited with status success for try_number 1 2024-04-03T03:40:13.480021190Z [2024-04-03T03:40:13.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:35:00+00:00, map_index=-1, run_start_date=2024-04-03 03:40:12.293506+00:00, run_end_date=2024-04-03 03:40:12.684019+00:00, run_duration=0.390513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:40:10.387147+00:00, queued_by_job_id=1, pid=10419 2024-04-03T03:41:00.888527930Z [2024-04-03T03:41:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:41:00+00:00, run_after=2024-04-03T03:42:00+00:00 2024-04-03T03:41:00.897198493Z [2024-04-03T03:41:00.896+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:41:00.987921939Z [2024-04-03T03:41:00.987+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:41:00.987952868Z 2024-04-03T03:41:00.987959135Z 2024-04-03T03:41:00.987994192Z [2024-04-03T03:41:00.987+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:41:00.988172570Z [2024-04-03T03:41:00.988+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:41:00.989031767Z [2024-04-03T03:41:00.988+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:41:00.989046376Z 2024-04-03T03:41:00.989051407Z 2024-04-03T03:41:00.995064128Z [2024-04-03T03:41:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:41:00.995848698Z [2024-04-03T03:41:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:41:00.996637628Z [2024-04-03T03:41:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:41:00.997221933Z [2024-04-03T03:41:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:41:01.259305238Z [2024-04-03T03:41:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status queued for try_number 1 2024-04-03T03:41:01.259352166Z [2024-04-03T03:41:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status queued for try_number 1 2024-04-03T03:41:01.268908636Z [2024-04-03T03:41:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0ad65f8-dc26-4641-aaac-8a564993194b 2024-04-03T03:41:01.268978516Z [2024-04-03T03:41:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 304add10-6d70-42ed-8b58-1efb376d7d1a 2024-04-03T03:41:04.853668181Z [2024-04-03T03:41:04.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:41:04.855118258Z [2024-04-03T03:41:04.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:40:00+00:00, run_id=scheduled__2024-04-03T03:40:00+00:00, run_start_date=2024-04-03 03:41:00.907884+00:00, run_end_date=2024-04-03 03:41:04.853773+00:00, run_duration=3.945889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:40:00+00:00, data_interval_end=2024-04-03 03:41:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:41:04.871939353Z [2024-04-03T03:41:04.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:41:00+00:00, run_after=2024-04-03T03:42:00+00:00 2024-04-03T03:41:05.990689601Z [2024-04-03T03:41:05.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status success for try_number 1 2024-04-03T03:41:05.995419799Z [2024-04-03T03:41:05.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:40:00+00:00, map_index=-1, run_start_date=2024-04-03 03:41:02.985673+00:00, run_end_date=2024-04-03 03:41:04.770165+00:00, run_duration=1.784492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:41:00.989625+00:00, queued_by_job_id=1, pid=10456 2024-04-03T03:41:06.854366362Z [2024-04-03T03:41:06.853+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:41:06.854680721Z [2024-04-03T03:41:06.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:40:00+00:00, run_id=scheduled__2024-04-03T03:40:00+00:00, run_start_date=2024-04-03 03:41:00.909255+00:00, run_end_date=2024-04-03 03:41:06.854344+00:00, run_duration=5.945089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:40:00+00:00, data_interval_end=2024-04-03 03:41:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:41:06.863396482Z [2024-04-03T03:41:06.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:41:00+00:00, run_after=2024-04-03T03:42:00+00:00 2024-04-03T03:41:06.889496230Z [2024-04-03T03:41:06.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status success for try_number 1 2024-04-03T03:41:06.894256226Z [2024-04-03T03:41:06.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:40:00+00:00, map_index=-1, run_start_date=2024-04-03 03:41:02.758217+00:00, run_end_date=2024-04-03 03:41:06.449673+00:00, run_duration=3.691456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:41:00.989625+00:00, queued_by_job_id=1, pid=10455 2024-04-03T03:41:36.280653265Z [2024-04-03T03:41:36.280+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:41:41.588087500Z [2024-04-03T03:41:41.587+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:41:41.588120095Z 2024-04-03T03:41:41.588144028Z [2024-04-03T03:41:41.587+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-03T03:41:41.588604268Z [2024-04-03T03:41:41.588+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:41:41.588638124Z 2024-04-03T03:41:41.591120403Z [2024-04-03T03:41:41.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240403034140_058481', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:41:41.591208507Z [2024-04-03T03:41:41.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240403034140_058481', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-03T03:41:41.665434934Z [2024-04-03T03:41:41.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240403034140_058481 exited with status queued for try_number 1 2024-04-03T03:41:41.675819645Z [2024-04-03T03:41:41.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 410deacb-0751-4c1d-aa56-0a04f13ee5fc 2024-04-03T03:41:42.738912143Z [2024-04-03T03:41:42.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:41:42.739236901Z [2024-04-03T03:41:42.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-03 03:41:40.813376+00:00, run_id=scaleout_vdu_20240403034140_058481, run_start_date=2024-04-03 03:41:41.562114+00:00, run_end_date=2024-04-03 03:41:42.738802+00:00, run_duration=1.176688, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-03 03:41:40.813376+00:00, data_interval_end=2024-04-03 03:41:40.813376+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-03T03:41:42.742083311Z [2024-04-03T03:41:42.741+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-03T03:41:43.910258384Z [2024-04-03T03:41:43.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240403034140_058481 exited with status success for try_number 1 2024-04-03T03:41:43.916498045Z [2024-04-03T03:41:43.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240403034140_058481, map_index=-1, run_start_date=2024-04-03 03:41:42.307182+00:00, run_end_date=2024-04-03 03:41:42.668597+00:00, run_duration=0.361415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:41:41.589009+00:00, queued_by_job_id=1, pid=10489 2024-04-03T03:42:00.817952262Z [2024-04-03T03:42:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:42:00+00:00, run_after=2024-04-03T03:43:00+00:00 2024-04-03T03:42:00.844829569Z [2024-04-03T03:42:00.839+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:42:00.860518992Z [2024-04-03T03:42:00.859+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:42:00.924425606Z [2024-04-03T03:42:00.924+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:42:00.924467367Z 2024-04-03T03:42:00.924483679Z 2024-04-03T03:42:00.924487698Z 2024-04-03T03:42:00.924632283Z [2024-04-03T03:42:00.924+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:42:00.924783693Z [2024-04-03T03:42:00.924+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:42:00.924922330Z [2024-04-03T03:42:00.924+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:42:00.925537455Z [2024-04-03T03:42:00.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:42:00.925552303Z 2024-04-03T03:42:00.925557491Z 2024-04-03T03:42:00.925562272Z 2024-04-03T03:42:00.928744069Z [2024-04-03T03:42:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:42:00.928961531Z [2024-04-03T03:42:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:42:00.929257991Z [2024-04-03T03:42:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:42:00.929420060Z [2024-04-03T03:42:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:42:00.929778249Z [2024-04-03T03:42:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:42:00.929957433Z [2024-04-03T03:42:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:42:01.389315005Z [2024-04-03T03:42:01.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status queued for try_number 1 2024-04-03T03:42:01.393076050Z [2024-04-03T03:42:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:41:00+00:00 exited with status queued for try_number 1 2024-04-03T03:42:01.394540374Z [2024-04-03T03:42:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:41:00+00:00 exited with status queued for try_number 1 2024-04-03T03:42:01.410822888Z [2024-04-03T03:42:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1be6f219-55fc-4421-986b-a37d8ca76130 2024-04-03T03:42:01.411212115Z [2024-04-03T03:42:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b7b8b6c-3e8f-48f8-a4d9-d73da7372639 2024-04-03T03:42:01.412144713Z [2024-04-03T03:42:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98ffb545-e90c-4f39-912c-9afe4c943ba7 2024-04-03T03:42:02.650966447Z [2024-04-03T03:42:02.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:42:02.651257954Z [2024-04-03T03:42:02.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:40:00+00:00, run_id=scheduled__2024-04-03T03:40:00+00:00, run_start_date=2024-04-03 03:42:00.873753+00:00, run_end_date=2024-04-03 03:42:02.650883+00:00, run_duration=1.77713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:40:00+00:00, data_interval_end=2024-04-03 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:42:02.661188926Z [2024-04-03T03:42:02.660+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:42:00+00:00, run_after=2024-04-03T03:44:00+00:00 2024-04-03T03:42:02.710924563Z [2024-04-03T03:42:02.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status success for try_number 1 2024-04-03T03:42:02.717314732Z [2024-04-03T03:42:02.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:40:00+00:00, map_index=-1, run_start_date=2024-04-03 03:42:01.839047+00:00, run_end_date=2024-04-03 03:42:02.218080+00:00, run_duration=0.379033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:42:00.926296+00:00, queued_by_job_id=1, pid=10503 2024-04-03T03:42:06.368991010Z [2024-04-03T03:42:06.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:42:06.369275451Z [2024-04-03T03:42:06.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:41:00+00:00, run_id=scheduled__2024-04-03T03:41:00+00:00, run_start_date=2024-04-03 03:42:00.875030+00:00, run_end_date=2024-04-03 03:42:06.368746+00:00, run_duration=5.493716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:41:00+00:00, data_interval_end=2024-04-03 03:42:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:42:06.382088958Z [2024-04-03T03:42:06.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:42:00+00:00, run_after=2024-04-03T03:43:00+00:00 2024-04-03T03:42:06.390953695Z [2024-04-03T03:42:06.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:42:06.392159073Z [2024-04-03T03:42:06.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:41:00+00:00, run_id=scheduled__2024-04-03T03:41:00+00:00, run_start_date=2024-04-03 03:42:00.876022+00:00, run_end_date=2024-04-03 03:42:06.390887+00:00, run_duration=5.514865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:41:00+00:00, data_interval_end=2024-04-03 03:42:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:42:06.409485908Z [2024-04-03T03:42:06.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:42:00+00:00, run_after=2024-04-03T03:43:00+00:00 2024-04-03T03:42:06.463767777Z [2024-04-03T03:42:06.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:41:00+00:00 exited with status success for try_number 1 2024-04-03T03:42:06.463789037Z [2024-04-03T03:42:06.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:41:00+00:00 exited with status success for try_number 1 2024-04-03T03:42:06.474525997Z [2024-04-03T03:42:06.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:41:00+00:00, map_index=-1, run_start_date=2024-04-03 03:42:03.343867+00:00, run_end_date=2024-04-03 03:42:05.332598+00:00, run_duration=1.988731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:42:00.926296+00:00, queued_by_job_id=1, pid=10534 2024-04-03T03:42:06.474540226Z [2024-04-03T03:42:06.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:41:00+00:00, map_index=-1, run_start_date=2024-04-03 03:42:03.158011+00:00, run_end_date=2024-04-03 03:42:05.293560+00:00, run_duration=2.135549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:42:00.926296+00:00, queued_by_job_id=1, pid=10533 2024-04-03T03:43:00.609908892Z [2024-04-03T03:43:00.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:43:00+00:00, run_after=2024-04-03T03:44:00+00:00 2024-04-03T03:43:00.618044034Z [2024-04-03T03:43:00.617+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:43:00.671218905Z [2024-04-03T03:43:00.670+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:43:00.671242368Z 2024-04-03T03:43:00.671246254Z 2024-04-03T03:43:00.671504522Z [2024-04-03T03:43:00.671+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:43:00.671715597Z [2024-04-03T03:43:00.671+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:43:00.672328912Z [2024-04-03T03:43:00.672+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:43:00.672339854Z 2024-04-03T03:43:00.672343422Z 2024-04-03T03:43:00.675322424Z [2024-04-03T03:43:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:43:00.675583367Z [2024-04-03T03:43:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:43:00.676044669Z [2024-04-03T03:43:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:43:00.676243909Z [2024-04-03T03:43:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:43:00.894212896Z [2024-04-03T03:43:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:42:00+00:00 exited with status queued for try_number 1 2024-04-03T03:43:00.894349441Z [2024-04-03T03:43:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:42:00+00:00 exited with status queued for try_number 1 2024-04-03T03:43:00.900372604Z [2024-04-03T03:43:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07f5e010-a464-46b4-869d-b713c10af2df 2024-04-03T03:43:00.900498239Z [2024-04-03T03:43:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to f322311d-1262-4036-bc87-243c1d49a46a 2024-04-03T03:43:04.518448215Z [2024-04-03T03:43:04.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:43:04.519633086Z [2024-04-03T03:43:04.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:42:00+00:00, run_id=scheduled__2024-04-03T03:42:00+00:00, run_start_date=2024-04-03 03:43:00.628136+00:00, run_end_date=2024-04-03 03:43:04.519196+00:00, run_duration=3.89106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:42:00+00:00, data_interval_end=2024-04-03 03:43:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:43:04.530097453Z [2024-04-03T03:43:04.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:43:00+00:00, run_after=2024-04-03T03:44:00+00:00 2024-04-03T03:43:05.636198726Z [2024-04-03T03:43:05.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:43:05.636461519Z [2024-04-03T03:43:05.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:42:00+00:00, run_id=scheduled__2024-04-03T03:42:00+00:00, run_start_date=2024-04-03 03:43:00.630007+00:00, run_end_date=2024-04-03 03:43:05.636043+00:00, run_duration=5.006036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:42:00+00:00, data_interval_end=2024-04-03 03:43:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:43:05.644662478Z [2024-04-03T03:43:05.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:43:00+00:00, run_after=2024-04-03T03:44:00+00:00 2024-04-03T03:43:05.680951434Z [2024-04-03T03:43:05.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:42:00+00:00 exited with status success for try_number 1 2024-04-03T03:43:05.680991507Z [2024-04-03T03:43:05.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:42:00+00:00 exited with status success for try_number 1 2024-04-03T03:43:05.687399652Z [2024-04-03T03:43:05.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:42:00+00:00, map_index=-1, run_start_date=2024-04-03 03:43:02.544704+00:00, run_end_date=2024-04-03 03:43:05.287553+00:00, run_duration=2.742849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:43:00.672999+00:00, queued_by_job_id=1, pid=10589 2024-04-03T03:43:05.687539706Z [2024-04-03T03:43:05.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:42:00+00:00, map_index=-1, run_start_date=2024-04-03 03:43:02.517749+00:00, run_end_date=2024-04-03 03:43:04.462746+00:00, run_duration=1.944997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:43:00.672999+00:00, queued_by_job_id=1, pid=10588 2024-04-03T03:44:00.327674830Z [2024-04-03T03:44:00.327+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:44:00.335666341Z [2024-04-03T03:44:00.335+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:44:00.349523146Z [2024-04-03T03:44:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:44:00+00:00, run_after=2024-04-03T03:45:00+00:00 2024-04-03T03:44:00.416892222Z [2024-04-03T03:44:00.416+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:44:00.416925247Z 2024-04-03T03:44:00.416929696Z 2024-04-03T03:44:00.416932825Z 2024-04-03T03:44:00.417046364Z [2024-04-03T03:44:00.416+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:44:00.417171647Z [2024-04-03T03:44:00.417+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:44:00.417290594Z [2024-04-03T03:44:00.417+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:44:00.417975254Z [2024-04-03T03:44:00.417+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:44:00.417987021Z 2024-04-03T03:44:00.417990965Z 2024-04-03T03:44:00.417994291Z 2024-04-03T03:44:00.421964487Z [2024-04-03T03:44:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:44:00.422174530Z [2024-04-03T03:44:00.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:44:00.422499123Z [2024-04-03T03:44:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:44:00.422730402Z [2024-04-03T03:44:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:44:00.423143266Z [2024-04-03T03:44:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:44:00.423327004Z [2024-04-03T03:44:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:44:00.882429978Z [2024-04-03T03:44:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:42:00+00:00 exited with status queued for try_number 1 2024-04-03T03:44:00.882458250Z [2024-04-03T03:44:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:43:00+00:00 exited with status queued for try_number 1 2024-04-03T03:44:00.882462008Z [2024-04-03T03:44:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:43:00+00:00 exited with status queued for try_number 1 2024-04-03T03:44:00.889260878Z [2024-04-03T03:44:00.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfbffc2b-da8a-4381-ac97-2cd7fe5ce1cc 2024-04-03T03:44:00.889294169Z [2024-04-03T03:44:00.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34bc1a94-294e-45c3-97f7-74a1825e74b1 2024-04-03T03:44:00.889298242Z [2024-04-03T03:44:00.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to f860cb4f-9d46-4cdc-ac33-765625072a42 2024-04-03T03:44:02.082795011Z [2024-04-03T03:44:02.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:44:02.083166056Z [2024-04-03T03:44:02.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:42:00+00:00, run_id=scheduled__2024-04-03T03:42:00+00:00, run_start_date=2024-04-03 03:44:00.359537+00:00, run_end_date=2024-04-03 03:44:02.082826+00:00, run_duration=1.723289, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:42:00+00:00, data_interval_end=2024-04-03 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:44:02.090712297Z [2024-04-03T03:44:02.090+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:44:00+00:00, run_after=2024-04-03T03:46:00+00:00 2024-04-03T03:44:02.132895585Z [2024-04-03T03:44:02.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:42:00+00:00 exited with status success for try_number 1 2024-04-03T03:44:02.139149286Z [2024-04-03T03:44:02.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:42:00+00:00, map_index=-1, run_start_date=2024-04-03 03:44:01.448401+00:00, run_end_date=2024-04-03 03:44:01.921141+00:00, run_duration=0.47274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:44:00.418770+00:00, queued_by_job_id=1, pid=10625 2024-04-03T03:44:04.971103010Z [2024-04-03T03:44:04.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:44:04.971304312Z [2024-04-03T03:44:04.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:43:00+00:00, run_id=scheduled__2024-04-03T03:43:00+00:00, run_start_date=2024-04-03 03:44:00.361929+00:00, run_end_date=2024-04-03 03:44:04.970942+00:00, run_duration=4.609013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:43:00+00:00, data_interval_end=2024-04-03 03:44:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:44:04.980037932Z [2024-04-03T03:44:04.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:44:00+00:00, run_after=2024-04-03T03:45:00+00:00 2024-04-03T03:44:04.986688670Z [2024-04-03T03:44:04.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:44:04.986856682Z [2024-04-03T03:44:04.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:43:00+00:00, run_id=scheduled__2024-04-03T03:43:00+00:00, run_start_date=2024-04-03 03:44:00.360845+00:00, run_end_date=2024-04-03 03:44:04.986491+00:00, run_duration=4.625646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:43:00+00:00, data_interval_end=2024-04-03 03:44:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:44:04.996714265Z [2024-04-03T03:44:04.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:44:00+00:00, run_after=2024-04-03T03:45:00+00:00 2024-04-03T03:44:05.038127553Z [2024-04-03T03:44:05.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:43:00+00:00 exited with status success for try_number 1 2024-04-03T03:44:05.038171753Z [2024-04-03T03:44:05.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:43:00+00:00 exited with status success for try_number 1 2024-04-03T03:44:05.045497636Z [2024-04-03T03:44:05.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:43:00+00:00, map_index=-1, run_start_date=2024-04-03 03:44:02.651041+00:00, run_end_date=2024-04-03 03:44:04.410226+00:00, run_duration=1.759185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:44:00.418770+00:00, queued_by_job_id=1, pid=10655 2024-04-03T03:44:05.045828499Z [2024-04-03T03:44:05.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:43:00+00:00, map_index=-1, run_start_date=2024-04-03 03:44:02.872414+00:00, run_end_date=2024-04-03 03:44:04.829366+00:00, run_duration=1.956952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:44:00.418770+00:00, queued_by_job_id=1, pid=10656 2024-04-03T03:45:01.110035780Z [2024-04-03T03:45:01.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:45:01.133223151Z [2024-04-03T03:45:01.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:45:00+00:00, run_after=2024-04-03T03:46:00+00:00 2024-04-03T03:45:01.155458417Z [2024-04-03T03:45:01.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:45:00+00:00, run_after=2024-04-03T03:50:00+00:00 2024-04-03T03:45:01.239656639Z [2024-04-03T03:45:01.239+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:45:01.239680176Z 2024-04-03T03:45:01.239684355Z 2024-04-03T03:45:01.239687839Z 2024-04-03T03:45:01.239697632Z [2024-04-03T03:45:01.239+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:45:01.239749889Z [2024-04-03T03:45:01.239+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:45:01.240505059Z [2024-04-03T03:45:01.239+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:45:01.241112083Z [2024-04-03T03:45:01.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:45:01.241124954Z 2024-04-03T03:45:01.241130205Z 2024-04-03T03:45:01.241135636Z 2024-04-03T03:45:01.244880468Z [2024-04-03T03:45:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:45:01.245006239Z [2024-04-03T03:45:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:45:01.245228512Z [2024-04-03T03:45:01.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:45:01.245310228Z [2024-04-03T03:45:01.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:45:01.245483292Z [2024-04-03T03:45:01.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:45:01.245559603Z [2024-04-03T03:45:01.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:45:01.623132624Z [2024-04-03T03:45:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status queued for try_number 1 2024-04-03T03:45:01.623349876Z [2024-04-03T03:45:01.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:44:00+00:00 exited with status queued for try_number 1 2024-04-03T03:45:01.623427965Z [2024-04-03T03:45:01.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:44:00+00:00 exited with status queued for try_number 1 2024-04-03T03:45:01.637174749Z [2024-04-03T03:45:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to f82596ad-0d1c-461a-9f16-c27b309c12c1 2024-04-03T03:45:01.637385915Z [2024-04-03T03:45:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab2b12c2-7786-4e9f-93ee-b59c5209cee4 2024-04-03T03:45:01.637520276Z [2024-04-03T03:45:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to e167bccf-10a5-43f3-8dc7-f3efb43af804 2024-04-03T03:45:05.145599755Z [2024-04-03T03:45:05.145+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:45:05.145629580Z 2024-04-03T03:45:05.145634536Z [2024-04-03T03:45:05.145+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:45:05.146199300Z [2024-04-03T03:45:05.145+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:45:05.146262689Z 2024-04-03T03:45:05.148856659Z [2024-04-03T03:45:05.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:45:05.148898174Z [2024-04-03T03:45:05.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:45:05.191772963Z [2024-04-03T03:45:05.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status queued for try_number 1 2024-04-03T03:45:05.191820115Z [2024-04-03T03:45:05.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status success for try_number 1 2024-04-03T03:45:05.196611356Z [2024-04-03T03:45:05.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 363b0327-94aa-4c54-9573-d804a0b71363 2024-04-03T03:45:05.196842836Z [2024-04-03T03:45:05.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:40:00+00:00, map_index=-1, run_start_date=2024-04-03 03:45:03.612363+00:00, run_end_date=2024-04-03 03:45:04.215188+00:00, run_duration=0.602825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:45:01.241868+00:00, queued_by_job_id=1, pid=10723 2024-04-03T03:45:05.385237607Z [2024-04-03T03:45:05.384+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:45:05.386210662Z [2024-04-03T03:45:05.385+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:44:00+00:00, run_id=scheduled__2024-04-03T03:44:00+00:00, run_start_date=2024-04-03 03:45:01.171450+00:00, run_end_date=2024-04-03 03:45:05.385718+00:00, run_duration=4.214268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:44:00+00:00, data_interval_end=2024-04-03 03:45:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:45:05.397060218Z [2024-04-03T03:45:05.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:45:00+00:00, run_after=2024-04-03T03:46:00+00:00 2024-04-03T03:45:06.507886117Z [2024-04-03T03:45:06.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:45:06.508222956Z [2024-04-03T03:45:06.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:44:00+00:00, run_id=scheduled__2024-04-03T03:44:00+00:00, run_start_date=2024-04-03 03:45:01.173371+00:00, run_end_date=2024-04-03 03:45:06.507894+00:00, run_duration=5.334523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:44:00+00:00, data_interval_end=2024-04-03 03:45:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:45:06.519146885Z [2024-04-03T03:45:06.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:45:00+00:00, run_after=2024-04-03T03:46:00+00:00 2024-04-03T03:45:06.564862883Z [2024-04-03T03:45:06.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:44:00+00:00 exited with status success for try_number 1 2024-04-03T03:45:06.565198371Z [2024-04-03T03:45:06.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:44:00+00:00 exited with status success for try_number 1 2024-04-03T03:45:06.574580528Z [2024-04-03T03:45:06.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:44:00+00:00, map_index=-1, run_start_date=2024-04-03 03:45:03.571113+00:00, run_end_date=2024-04-03 03:45:05.326106+00:00, run_duration=1.754993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:45:01.241868+00:00, queued_by_job_id=1, pid=10721 2024-04-03T03:45:06.575006083Z [2024-04-03T03:45:06.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:44:00+00:00, map_index=-1, run_start_date=2024-04-03 03:45:03.600959+00:00, run_end_date=2024-04-03 03:45:05.723440+00:00, run_duration=2.122481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:45:01.241868+00:00, queued_by_job_id=1, pid=10722 2024-04-03T03:45:07.658885212Z [2024-04-03T03:45:07.658+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:45:07.658920662Z 2024-04-03T03:45:07.659182624Z [2024-04-03T03:45:07.658+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:45:07.660049166Z [2024-04-03T03:45:07.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:45:07.660065374Z 2024-04-03T03:45:07.663334904Z [2024-04-03T03:45:07.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:45:07.663620953Z [2024-04-03T03:45:07.663+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:45:07.739203927Z [2024-04-03T03:45:07.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status queued for try_number 1 2024-04-03T03:45:07.739240082Z [2024-04-03T03:45:07.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status success for try_number 1 2024-04-03T03:45:07.746140319Z [2024-04-03T03:45:07.745+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fa28580-f5a6-41a6-a995-e923fd947beb 2024-04-03T03:45:07.746241135Z [2024-04-03T03:45:07.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:40:00+00:00, map_index=-1, run_start_date=2024-04-03 03:45:06.857254+00:00, run_end_date=2024-04-03 03:45:07.236953+00:00, run_duration=0.379699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:45:05.146429+00:00, queued_by_job_id=1, pid=10762 2024-04-03T03:45:10.029292251Z [2024-04-03T03:45:10.028+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:45:10.029322234Z 2024-04-03T03:45:10.029837407Z [2024-04-03T03:45:10.029+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:45:10.036010640Z [2024-04-03T03:45:10.035+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:45:10.036044191Z 2024-04-03T03:45:10.052385344Z [2024-04-03T03:45:10.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:45:10.052411253Z [2024-04-03T03:45:10.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:45:10.165208336Z [2024-04-03T03:45:10.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status queued for try_number 1 2024-04-03T03:45:10.165235920Z [2024-04-03T03:45:10.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status success for try_number 1 2024-04-03T03:45:10.180297531Z [2024-04-03T03:45:10.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d26b399-7ecb-49d5-a53c-698958cfbc74 2024-04-03T03:45:10.180327679Z [2024-04-03T03:45:10.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:40:00+00:00, map_index=0, run_start_date=2024-04-03 03:45:09.480060+00:00, run_end_date=2024-04-03 03:45:09.810438+00:00, run_duration=0.330378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:45:07.660573+00:00, queued_by_job_id=1, pid=10774 2024-04-03T03:45:12.437603415Z [2024-04-03T03:45:12.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:45:12.438206001Z [2024-04-03T03:45:12.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:40:00+00:00, run_id=scheduled__2024-04-03T03:40:00+00:00, run_start_date=2024-04-03 03:45:01.170017+00:00, run_end_date=2024-04-03 03:45:12.437468+00:00, run_duration=11.267451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:40:00+00:00, data_interval_end=2024-04-03 03:45:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:45:12.448466850Z [2024-04-03T03:45:12.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:45:00+00:00, run_after=2024-04-03T03:50:00+00:00 2024-04-03T03:45:12.482226436Z [2024-04-03T03:45:12.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:40:00+00:00 exited with status success for try_number 1 2024-04-03T03:45:12.490046137Z [2024-04-03T03:45:12.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:40:00+00:00, map_index=-1, run_start_date=2024-04-03 03:45:11.842051+00:00, run_end_date=2024-04-03 03:45:12.280060+00:00, run_duration=0.438009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:45:10.037822+00:00, queued_by_job_id=1, pid=10786 2024-04-03T03:46:00.742139401Z [2024-04-03T03:46:00.741+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:46:00.758187241Z [2024-04-03T03:46:00.757+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:46:00+00:00, run_after=2024-04-03T03:47:00+00:00 2024-04-03T03:46:00.792238696Z [2024-04-03T03:46:00.789+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:46:00.892465001Z [2024-04-03T03:46:00.892+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:46:00.892491085Z 2024-04-03T03:46:00.892495299Z 2024-04-03T03:46:00.892498479Z 2024-04-03T03:46:00.892725118Z [2024-04-03T03:46:00.892+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:46:00.892955695Z [2024-04-03T03:46:00.892+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:46:00.893282920Z [2024-04-03T03:46:00.893+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:46:00.893801615Z [2024-04-03T03:46:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:46:00.893812698Z 2024-04-03T03:46:00.893816301Z 2024-04-03T03:46:00.893819509Z 2024-04-03T03:46:00.898023336Z [2024-04-03T03:46:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:46:00.898213582Z [2024-04-03T03:46:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:46:00.898420268Z [2024-04-03T03:46:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:46:00.898499784Z [2024-04-03T03:46:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:46:00.898695558Z [2024-04-03T03:46:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:46:00.898781191Z [2024-04-03T03:46:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:46:01.260455200Z [2024-04-03T03:46:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:44:00+00:00 exited with status queued for try_number 1 2024-04-03T03:46:01.260531750Z [2024-04-03T03:46:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status queued for try_number 1 2024-04-03T03:46:01.260546167Z [2024-04-03T03:46:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status queued for try_number 1 2024-04-03T03:46:01.302202352Z [2024-04-03T03:46:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e7872d8-bf68-49a4-8994-fa7c8e574396 2024-04-03T03:46:01.302234646Z [2024-04-03T03:46:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83f1204c-41a9-4b97-8bc8-318850a124ce 2024-04-03T03:46:01.302321502Z [2024-04-03T03:46:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae4c5bfb-be74-4257-8f1d-5eea78d3f66f 2024-04-03T03:46:03.652959948Z [2024-04-03T03:46:03.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:46:03.653412054Z [2024-04-03T03:46:03.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:44:00+00:00, run_id=scheduled__2024-04-03T03:44:00+00:00, run_start_date=2024-04-03 03:46:00.823313+00:00, run_end_date=2024-04-03 03:46:03.652825+00:00, run_duration=2.829512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:44:00+00:00, data_interval_end=2024-04-03 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:46:03.670807745Z [2024-04-03T03:46:03.670+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:46:00+00:00, run_after=2024-04-03T03:48:00+00:00 2024-04-03T03:46:03.743917401Z [2024-04-03T03:46:03.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:44:00+00:00 exited with status success for try_number 1 2024-04-03T03:46:03.749398497Z [2024-04-03T03:46:03.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:44:00+00:00, map_index=-1, run_start_date=2024-04-03 03:46:02.116800+00:00, run_end_date=2024-04-03 03:46:02.575005+00:00, run_duration=0.458205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:46:00.894622+00:00, queued_by_job_id=1, pid=10803 2024-04-03T03:46:05.821436066Z [2024-04-03T03:46:05.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:46:05.821775197Z [2024-04-03T03:46:05.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:45:00+00:00, run_id=scheduled__2024-04-03T03:45:00+00:00, run_start_date=2024-04-03 03:46:00.830316+00:00, run_end_date=2024-04-03 03:46:05.821442+00:00, run_duration=4.991126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:45:00+00:00, data_interval_end=2024-04-03 03:46:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:46:05.831646166Z [2024-04-03T03:46:05.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:46:00+00:00, run_after=2024-04-03T03:47:00+00:00 2024-04-03T03:46:05.838012075Z [2024-04-03T03:46:05.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:46:05.838688634Z [2024-04-03T03:46:05.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:45:00+00:00, run_id=scheduled__2024-04-03T03:45:00+00:00, run_start_date=2024-04-03 03:46:00.828199+00:00, run_end_date=2024-04-03 03:46:05.838320+00:00, run_duration=5.010121, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:45:00+00:00, data_interval_end=2024-04-03 03:46:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:46:05.848061840Z [2024-04-03T03:46:05.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:46:00+00:00, run_after=2024-04-03T03:47:00+00:00 2024-04-03T03:46:05.874800724Z [2024-04-03T03:46:05.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status success for try_number 1 2024-04-03T03:46:05.874964141Z [2024-04-03T03:46:05.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status success for try_number 1 2024-04-03T03:46:05.880810903Z [2024-04-03T03:46:05.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:45:00+00:00, map_index=-1, run_start_date=2024-04-03 03:46:03.352122+00:00, run_end_date=2024-04-03 03:46:05.524132+00:00, run_duration=2.17201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:46:00.894622+00:00, queued_by_job_id=1, pid=10833 2024-04-03T03:46:05.881082493Z [2024-04-03T03:46:05.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:45:00+00:00, map_index=-1, run_start_date=2024-04-03 03:46:03.629403+00:00, run_end_date=2024-04-03 03:46:05.562005+00:00, run_duration=1.932602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:46:00.894622+00:00, queued_by_job_id=1, pid=10834 2024-04-03T03:46:36.337530778Z [2024-04-03T03:46:36.336+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:47:00.950034823Z [2024-04-03T03:47:00.949+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:47:00.970824760Z [2024-04-03T03:47:00.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:47:00+00:00, run_after=2024-04-03T03:48:00+00:00 2024-04-03T03:47:01.074876667Z [2024-04-03T03:47:01.074+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:47:01.074918261Z 2024-04-03T03:47:01.074924117Z 2024-04-03T03:47:01.075148716Z [2024-04-03T03:47:01.074+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:47:01.075331516Z [2024-04-03T03:47:01.075+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:47:01.076003279Z [2024-04-03T03:47:01.075+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:47:01.076014120Z 2024-04-03T03:47:01.076018886Z 2024-04-03T03:47:01.082462949Z [2024-04-03T03:47:01.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:47:01.083081779Z [2024-04-03T03:47:01.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:47:01.083352720Z [2024-04-03T03:47:01.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:47:01.083659121Z [2024-04-03T03:47:01.083+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:47:01.264098175Z [2024-04-03T03:47:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:46:00+00:00 exited with status queued for try_number 1 2024-04-03T03:47:01.266860122Z [2024-04-03T03:47:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:46:00+00:00 exited with status queued for try_number 1 2024-04-03T03:47:01.275917109Z [2024-04-03T03:47:01.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c1a5dde-215e-4b19-ad34-05030b7b3e9a 2024-04-03T03:47:01.277012505Z [2024-04-03T03:47:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90db368e-aab9-4381-b77f-3c403ec307c1 2024-04-03T03:47:05.530877774Z [2024-04-03T03:47:05.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:47:05.531085982Z [2024-04-03T03:47:05.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:46:00+00:00, run_id=scheduled__2024-04-03T03:46:00+00:00, run_start_date=2024-04-03 03:47:00.983223+00:00, run_end_date=2024-04-03 03:47:05.530753+00:00, run_duration=4.54753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:46:00+00:00, data_interval_end=2024-04-03 03:47:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:47:05.542002870Z [2024-04-03T03:47:05.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:47:00+00:00, run_after=2024-04-03T03:48:00+00:00 2024-04-03T03:47:05.550392616Z [2024-04-03T03:47:05.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:47:05.550462143Z [2024-04-03T03:47:05.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:46:00+00:00, run_id=scheduled__2024-04-03T03:46:00+00:00, run_start_date=2024-04-03 03:47:00.981935+00:00, run_end_date=2024-04-03 03:47:05.550231+00:00, run_duration=4.568296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:46:00+00:00, data_interval_end=2024-04-03 03:47:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:47:05.560044429Z [2024-04-03T03:47:05.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:47:00+00:00, run_after=2024-04-03T03:48:00+00:00 2024-04-03T03:47:05.589867322Z [2024-04-03T03:47:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:46:00+00:00 exited with status success for try_number 1 2024-04-03T03:47:05.590010606Z [2024-04-03T03:47:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:46:00+00:00 exited with status success for try_number 1 2024-04-03T03:47:05.597407476Z [2024-04-03T03:47:05.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:46:00+00:00, map_index=-1, run_start_date=2024-04-03 03:47:03.411392+00:00, run_end_date=2024-04-03 03:47:05.253444+00:00, run_duration=1.842052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:47:01.078306+00:00, queued_by_job_id=1, pid=10890 2024-04-03T03:47:05.597721309Z [2024-04-03T03:47:05.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:46:00+00:00, map_index=-1, run_start_date=2024-04-03 03:47:03.340979+00:00, run_end_date=2024-04-03 03:47:05.389299+00:00, run_duration=2.04832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:47:01.078306+00:00, queued_by_job_id=1, pid=10889 2024-04-03T03:47:41.877330529Z [2024-04-03T03:47:41.876+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:47:41.877370171Z 2024-04-03T03:47:41.877411253Z [2024-04-03T03:47:41.877+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-03T03:47:41.877883699Z [2024-04-03T03:47:41.877+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:47:41.877894166Z 2024-04-03T03:47:41.880398152Z [2024-04-03T03:47:41.880+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240403034740_769917', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:47:41.880510423Z [2024-04-03T03:47:41.880+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240403034740_769917', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-03T03:47:41.929752043Z [2024-04-03T03:47:41.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240403034740_769917 exited with status queued for try_number 1 2024-04-03T03:47:41.935181994Z [2024-04-03T03:47:41.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5051c60-ef55-45fc-b039-ece35fb85790 2024-04-03T03:47:43.182641393Z [2024-04-03T03:47:43.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:47:43.184273239Z [2024-04-03T03:47:43.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-03 03:47:40.844057+00:00, run_id=scaleout_vdu_20240403034740_769917, run_start_date=2024-04-03 03:47:41.841993+00:00, run_end_date=2024-04-03 03:47:43.182486+00:00, run_duration=1.340493, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-03 03:47:40.844057+00:00, data_interval_end=2024-04-03 03:47:40.844057+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-03T03:47:43.187559183Z [2024-04-03T03:47:43.187+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-03T03:47:43.214169711Z [2024-04-03T03:47:43.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240403034740_769917 exited with status success for try_number 1 2024-04-03T03:47:43.221575858Z [2024-04-03T03:47:43.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240403034740_769917, map_index=-1, run_start_date=2024-04-03 03:47:42.626290+00:00, run_end_date=2024-04-03 03:47:43.050972+00:00, run_duration=0.424682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:47:41.878169+00:00, queued_by_job_id=1, pid=10923 2024-04-03T03:48:00.165104088Z [2024-04-03T03:48:00.160+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:48:00.174716213Z [2024-04-03T03:48:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:48:00+00:00, run_after=2024-04-03T03:49:00+00:00 2024-04-03T03:48:00.181376254Z [2024-04-03T03:48:00.180+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:48:00.256652750Z [2024-04-03T03:48:00.256+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:48:00.256678290Z 2024-04-03T03:48:00.256682748Z 2024-04-03T03:48:00.256685929Z 2024-04-03T03:48:00.256705166Z [2024-04-03T03:48:00.256+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:48:00.256763912Z [2024-04-03T03:48:00.256+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:48:00.256842327Z [2024-04-03T03:48:00.256+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:48:00.257425598Z [2024-04-03T03:48:00.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:48:00.257442438Z 2024-04-03T03:48:00.257456531Z 2024-04-03T03:48:00.257461036Z 2024-04-03T03:48:00.260126742Z [2024-04-03T03:48:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:48:00.260195080Z [2024-04-03T03:48:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:48:00.260381252Z [2024-04-03T03:48:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:48:00.260443103Z [2024-04-03T03:48:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:48:00.261056263Z [2024-04-03T03:48:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:48:00.261208652Z [2024-04-03T03:48:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:48:00.544385311Z [2024-04-03T03:48:00.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:46:00+00:00 exited with status queued for try_number 1 2024-04-03T03:48:00.544425782Z [2024-04-03T03:48:00.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:47:00+00:00 exited with status queued for try_number 1 2024-04-03T03:48:00.544472690Z [2024-04-03T03:48:00.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:47:00+00:00 exited with status queued for try_number 1 2024-04-03T03:48:00.552303207Z [2024-04-03T03:48:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 721bae18-f44a-4678-b71d-7ba6b9911b3a 2024-04-03T03:48:00.552359326Z [2024-04-03T03:48:00.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64bf1af4-86cb-4901-bc14-270876829e70 2024-04-03T03:48:00.552464084Z [2024-04-03T03:48:00.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b022a18-ec74-4a79-b7d3-6fc301daaf93 2024-04-03T03:48:02.922079152Z [2024-04-03T03:48:02.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:48:02.922331075Z [2024-04-03T03:48:02.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:46:00+00:00, run_id=scheduled__2024-04-03T03:46:00+00:00, run_start_date=2024-04-03 03:48:00.188909+00:00, run_end_date=2024-04-03 03:48:02.921999+00:00, run_duration=2.73309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:46:00+00:00, data_interval_end=2024-04-03 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:48:02.930526986Z [2024-04-03T03:48:02.930+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:48:00+00:00, run_after=2024-04-03T03:50:00+00:00 2024-04-03T03:48:02.975775745Z [2024-04-03T03:48:02.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:46:00+00:00 exited with status success for try_number 1 2024-04-03T03:48:02.982764079Z [2024-04-03T03:48:02.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:46:00+00:00, map_index=-1, run_start_date=2024-04-03 03:48:01.298838+00:00, run_end_date=2024-04-03 03:48:01.842320+00:00, run_duration=0.543482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:48:00.257948+00:00, queued_by_job_id=1, pid=10936 2024-04-03T03:48:05.139247438Z [2024-04-03T03:48:05.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:48:05.139518052Z [2024-04-03T03:48:05.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:47:00+00:00, run_id=scheduled__2024-04-03T03:47:00+00:00, run_start_date=2024-04-03 03:48:00.191716+00:00, run_end_date=2024-04-03 03:48:05.139180+00:00, run_duration=4.947464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:47:00+00:00, data_interval_end=2024-04-03 03:48:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:48:05.151208369Z [2024-04-03T03:48:05.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:48:00+00:00, run_after=2024-04-03T03:49:00+00:00 2024-04-03T03:48:05.200274880Z [2024-04-03T03:48:05.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:47:00+00:00 exited with status success for try_number 1 2024-04-03T03:48:05.205415820Z [2024-04-03T03:48:05.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:47:00+00:00, map_index=-1, run_start_date=2024-04-03 03:48:02.514611+00:00, run_end_date=2024-04-03 03:48:04.620240+00:00, run_duration=2.105629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:48:00.257948+00:00, queued_by_job_id=1, pid=10966 2024-04-03T03:48:06.241707786Z [2024-04-03T03:48:06.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:48:06.242055620Z [2024-04-03T03:48:06.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:47:00+00:00, run_id=scheduled__2024-04-03T03:47:00+00:00, run_start_date=2024-04-03 03:48:00.189984+00:00, run_end_date=2024-04-03 03:48:06.241693+00:00, run_duration=6.051709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:47:00+00:00, data_interval_end=2024-04-03 03:48:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:48:06.251682575Z [2024-04-03T03:48:06.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:48:00+00:00, run_after=2024-04-03T03:49:00+00:00 2024-04-03T03:48:06.276169561Z [2024-04-03T03:48:06.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:47:00+00:00 exited with status success for try_number 1 2024-04-03T03:48:06.280813673Z [2024-04-03T03:48:06.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:47:00+00:00, map_index=-1, run_start_date=2024-04-03 03:48:02.627569+00:00, run_end_date=2024-04-03 03:48:05.142447+00:00, run_duration=2.514878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:48:00.257948+00:00, queued_by_job_id=1, pid=10967 2024-04-03T03:49:00.708909617Z [2024-04-03T03:49:00.708+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:49:00.724402685Z [2024-04-03T03:49:00.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:49:00+00:00, run_after=2024-04-03T03:50:00+00:00 2024-04-03T03:49:00.802548408Z [2024-04-03T03:49:00.802+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:49:00.802584108Z 2024-04-03T03:49:00.802623543Z 2024-04-03T03:49:00.802675441Z [2024-04-03T03:49:00.802+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:49:00.802680067Z [2024-04-03T03:49:00.802+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:49:00.803163884Z [2024-04-03T03:49:00.802+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:49:00.803170865Z 2024-04-03T03:49:00.803184846Z 2024-04-03T03:49:00.805753387Z [2024-04-03T03:49:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:49:00.805860759Z [2024-04-03T03:49:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:49:00.806068032Z [2024-04-03T03:49:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:49:00.806159319Z [2024-04-03T03:49:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:49:00.996801134Z [2024-04-03T03:49:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:48:00+00:00 exited with status queued for try_number 1 2024-04-03T03:49:00.996947076Z [2024-04-03T03:49:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:48:00+00:00 exited with status queued for try_number 1 2024-04-03T03:49:01.003968579Z [2024-04-03T03:49:01.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44648bc1-b931-45af-8188-baf8169f92ee 2024-04-03T03:49:01.006585448Z [2024-04-03T03:49:01.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to 487b000c-ffb7-4d73-89ac-ddedefbfdd2e 2024-04-03T03:49:04.776808845Z [2024-04-03T03:49:04.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:49:04.777327406Z [2024-04-03T03:49:04.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:48:00+00:00, run_id=scheduled__2024-04-03T03:48:00+00:00, run_start_date=2024-04-03 03:49:00.736030+00:00, run_end_date=2024-04-03 03:49:04.776927+00:00, run_duration=4.040897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:48:00+00:00, data_interval_end=2024-04-03 03:49:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:49:04.787343752Z [2024-04-03T03:49:04.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:49:00+00:00, run_after=2024-04-03T03:50:00+00:00 2024-04-03T03:49:04.793904654Z [2024-04-03T03:49:04.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:49:04.794329473Z [2024-04-03T03:49:04.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:48:00+00:00, run_id=scheduled__2024-04-03T03:48:00+00:00, run_start_date=2024-04-03 03:49:00.734676+00:00, run_end_date=2024-04-03 03:49:04.794027+00:00, run_duration=4.059351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:48:00+00:00, data_interval_end=2024-04-03 03:49:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:49:04.803870350Z [2024-04-03T03:49:04.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:49:00+00:00, run_after=2024-04-03T03:50:00+00:00 2024-04-03T03:49:04.830660329Z [2024-04-03T03:49:04.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:48:00+00:00 exited with status success for try_number 1 2024-04-03T03:49:04.830684448Z [2024-04-03T03:49:04.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:48:00+00:00 exited with status success for try_number 1 2024-04-03T03:49:04.837402736Z [2024-04-03T03:49:04.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:48:00+00:00, map_index=-1, run_start_date=2024-04-03 03:49:02.642356+00:00, run_end_date=2024-04-03 03:49:04.370176+00:00, run_duration=1.72782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:49:00.803611+00:00, queued_by_job_id=1, pid=11022 2024-04-03T03:49:04.837631438Z [2024-04-03T03:49:04.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:48:00+00:00, map_index=-1, run_start_date=2024-04-03 03:49:02.624858+00:00, run_end_date=2024-04-03 03:49:04.031629+00:00, run_duration=1.406771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:49:00.803611+00:00, queued_by_job_id=1, pid=11021 2024-04-03T03:49:41.343753958Z [2024-04-03T03:49:41.343+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:49:41.343789182Z 2024-04-03T03:49:41.344042297Z [2024-04-03T03:49:41.343+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-03T03:49:41.344632462Z [2024-04-03T03:49:41.344+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:49:41.344648647Z 2024-04-03T03:49:41.347303216Z [2024-04-03T03:49:41.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240403034940_527211', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:49:41.347467364Z [2024-04-03T03:49:41.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240403034940_527211', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-03T03:49:41.414231189Z [2024-04-03T03:49:41.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240403034940_527211 exited with status queued for try_number 1 2024-04-03T03:49:41.424946564Z [2024-04-03T03:49:41.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 883cef27-7186-4660-9436-ce37e196c755 2024-04-03T03:49:42.578292636Z [2024-04-03T03:49:42.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:49:42.578339170Z [2024-04-03T03:49:42.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-03 03:49:40.902407+00:00, run_id=scaleout_vdu_20240403034940_527211, run_start_date=2024-04-03 03:49:41.301712+00:00, run_end_date=2024-04-03 03:49:42.577600+00:00, run_duration=1.275888, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-03 03:49:40.902407+00:00, data_interval_end=2024-04-03 03:49:40.902407+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-03T03:49:42.581541494Z [2024-04-03T03:49:42.580+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-03T03:49:43.363502357Z [2024-04-03T03:49:43.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240403034940_527211 exited with status success for try_number 1 2024-04-03T03:49:43.377516629Z [2024-04-03T03:49:43.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240403034940_527211, map_index=-1, run_start_date=2024-04-03 03:49:42.175954+00:00, run_end_date=2024-04-03 03:49:42.548639+00:00, run_duration=0.372685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:49:41.344952+00:00, queued_by_job_id=1, pid=11056 2024-04-03T03:50:00.493944764Z [2024-04-03T03:50:00.493+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:50:00.505552698Z [2024-04-03T03:50:00.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:50:00+00:00, run_after=2024-04-03T03:55:00+00:00 2024-04-03T03:50:00.517032132Z [2024-04-03T03:50:00.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:50:00+00:00, run_after=2024-04-03T03:51:00+00:00 2024-04-03T03:50:00.523157509Z [2024-04-03T03:50:00.522+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:50:00.603485781Z [2024-04-03T03:50:00.602+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T03:50:00.603517299Z 2024-04-03T03:50:00.603524154Z 2024-04-03T03:50:00.603530709Z 2024-04-03T03:50:00.603536150Z 2024-04-03T03:50:00.605043253Z [2024-04-03T03:50:00.604+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:50:00.605388509Z [2024-04-03T03:50:00.605+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:50:00.605763087Z [2024-04-03T03:50:00.605+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:50:00.606070283Z [2024-04-03T03:50:00.605+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:50:00.607306389Z [2024-04-03T03:50:00.607+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:50:00.607317363Z 2024-04-03T03:50:00.607321144Z 2024-04-03T03:50:00.607324671Z 2024-04-03T03:50:00.607327834Z 2024-04-03T03:50:00.616369438Z [2024-04-03T03:50:00.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:50:00.616694979Z [2024-04-03T03:50:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:50:00.617109737Z [2024-04-03T03:50:00.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:50:00.617385511Z [2024-04-03T03:50:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:50:00.617803934Z [2024-04-03T03:50:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:50:00.618032488Z [2024-04-03T03:50:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:50:00.618290181Z [2024-04-03T03:50:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:50:00.618489148Z [2024-04-03T03:50:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:50:00.960834543Z [2024-04-03T03:50:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status queued for try_number 1 2024-04-03T03:50:00.963556869Z [2024-04-03T03:50:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:48:00+00:00 exited with status queued for try_number 1 2024-04-03T03:50:00.963777172Z [2024-04-03T03:50:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:49:00+00:00 exited with status queued for try_number 1 2024-04-03T03:50:00.963942896Z [2024-04-03T03:50:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:49:00+00:00 exited with status queued for try_number 1 2024-04-03T03:50:00.972101511Z [2024-04-03T03:50:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2d174d7-d438-4a54-afd0-03f3d6daf6de 2024-04-03T03:50:00.972373327Z [2024-04-03T03:50:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91762c1e-477d-42e0-bf2f-081f77ca22a5 2024-04-03T03:50:00.972621996Z [2024-04-03T03:50:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11e327fe-a963-4849-989d-96c61036c73c 2024-04-03T03:50:00.972832024Z [2024-04-03T03:50:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to d70e2e5c-5bec-49bb-ba37-ec34008b12d8 2024-04-03T03:50:03.300332324Z [2024-04-03T03:50:03.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:50:03.300820512Z [2024-04-03T03:50:03.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:48:00+00:00, run_id=scheduled__2024-04-03T03:48:00+00:00, run_start_date=2024-04-03 03:50:00.533736+00:00, run_end_date=2024-04-03 03:50:03.300469+00:00, run_duration=2.766733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:48:00+00:00, data_interval_end=2024-04-03 03:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:50:03.309114571Z [2024-04-03T03:50:03.308+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:50:00+00:00, run_after=2024-04-03T03:52:00+00:00 2024-04-03T03:50:03.376832952Z [2024-04-03T03:50:03.376+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:50:03.376856861Z 2024-04-03T03:50:03.377102153Z [2024-04-03T03:50:03.376+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:50:03.377720726Z [2024-04-03T03:50:03.377+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:50:03.377732061Z 2024-04-03T03:50:03.387068190Z [2024-04-03T03:50:03.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:50:03.387442748Z [2024-04-03T03:50:03.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:50:03.465924096Z [2024-04-03T03:50:03.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status queued for try_number 1 2024-04-03T03:50:03.465981976Z [2024-04-03T03:50:03.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:48:00+00:00 exited with status success for try_number 1 2024-04-03T03:50:03.481037659Z [2024-04-03T03:50:03.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:48:00+00:00, map_index=-1, run_start_date=2024-04-03 03:50:01.794659+00:00, run_end_date=2024-04-03 03:50:02.180297+00:00, run_duration=0.385638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:50:00.610268+00:00, queued_by_job_id=1, pid=11070 2024-04-03T03:50:03.481149267Z [2024-04-03T03:50:03.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22bedd48-9ae5-4e00-a4fe-816743eeb2f1 2024-04-03T03:50:03.680800876Z [2024-04-03T03:50:03.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status success for try_number 1 2024-04-03T03:50:03.699354878Z [2024-04-03T03:50:03.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:45:00+00:00, map_index=-1, run_start_date=2024-04-03 03:50:02.825964+00:00, run_end_date=2024-04-03 03:50:03.275527+00:00, run_duration=0.449563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:50:00.610268+00:00, queued_by_job_id=1, pid=11092 2024-04-03T03:50:05.614381927Z [2024-04-03T03:50:05.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:50:05.614540804Z [2024-04-03T03:50:05.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:49:00+00:00, run_id=scheduled__2024-04-03T03:49:00+00:00, run_start_date=2024-04-03 03:50:00.536079+00:00, run_end_date=2024-04-03 03:50:05.614275+00:00, run_duration=5.078196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:49:00+00:00, data_interval_end=2024-04-03 03:50:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:50:05.623778952Z [2024-04-03T03:50:05.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:50:00+00:00, run_after=2024-04-03T03:51:00+00:00 2024-04-03T03:50:05.630076731Z [2024-04-03T03:50:05.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:50:05.630214778Z [2024-04-03T03:50:05.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:49:00+00:00, run_id=scheduled__2024-04-03T03:49:00+00:00, run_start_date=2024-04-03 03:50:00.535164+00:00, run_end_date=2024-04-03 03:50:05.629966+00:00, run_duration=5.094802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:49:00+00:00, data_interval_end=2024-04-03 03:50:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:50:05.639855392Z [2024-04-03T03:50:05.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:50:00+00:00, run_after=2024-04-03T03:51:00+00:00 2024-04-03T03:50:05.675558701Z [2024-04-03T03:50:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:49:00+00:00 exited with status success for try_number 1 2024-04-03T03:50:05.675604050Z [2024-04-03T03:50:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:49:00+00:00 exited with status success for try_number 1 2024-04-03T03:50:05.682641937Z [2024-04-03T03:50:05.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:49:00+00:00, map_index=-1, run_start_date=2024-04-03 03:50:03.421168+00:00, run_end_date=2024-04-03 03:50:04.963290+00:00, run_duration=1.542122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:50:00.610268+00:00, queued_by_job_id=1, pid=11122 2024-04-03T03:50:05.682763735Z [2024-04-03T03:50:05.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:49:00+00:00, map_index=-1, run_start_date=2024-04-03 03:50:03.329858+00:00, run_end_date=2024-04-03 03:50:05.263813+00:00, run_duration=1.933955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:50:00.610268+00:00, queued_by_job_id=1, pid=11120 2024-04-03T03:50:06.738419408Z [2024-04-03T03:50:06.738+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:50:06.738447686Z 2024-04-03T03:50:06.738498680Z [2024-04-03T03:50:06.738+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:50:06.739127334Z [2024-04-03T03:50:06.738+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:50:06.739138608Z 2024-04-03T03:50:06.741466011Z [2024-04-03T03:50:06.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:50:06.741684289Z [2024-04-03T03:50:06.741+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:50:06.789132613Z [2024-04-03T03:50:06.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status queued for try_number 1 2024-04-03T03:50:06.789177337Z [2024-04-03T03:50:06.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status success for try_number 1 2024-04-03T03:50:06.794391984Z [2024-04-03T03:50:06.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8b079ec-476a-49c3-866a-4ed693854637 2024-04-03T03:50:06.794543606Z [2024-04-03T03:50:06.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:45:00+00:00, map_index=-1, run_start_date=2024-04-03 03:50:05.419246+00:00, run_end_date=2024-04-03 03:50:05.741141+00:00, run_duration=0.321895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:50:03.378174+00:00, queued_by_job_id=1, pid=11151 2024-04-03T03:50:09.649107498Z [2024-04-03T03:50:09.647+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:50:09.649135010Z 2024-04-03T03:50:09.650357000Z [2024-04-03T03:50:09.649+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:50:09.652052277Z [2024-04-03T03:50:09.651+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:50:09.652064330Z 2024-04-03T03:50:09.656905064Z [2024-04-03T03:50:09.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:50:09.657312387Z [2024-04-03T03:50:09.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:50:09.723730269Z [2024-04-03T03:50:09.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status queued for try_number 1 2024-04-03T03:50:09.724127044Z [2024-04-03T03:50:09.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status success for try_number 1 2024-04-03T03:50:09.732981126Z [2024-04-03T03:50:09.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08caabdd-86ce-4937-bef9-d19e17e10954 2024-04-03T03:50:09.733330442Z [2024-04-03T03:50:09.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:45:00+00:00, map_index=0, run_start_date=2024-04-03 03:50:08.404750+00:00, run_end_date=2024-04-03 03:50:09.518564+00:00, run_duration=1.113814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:50:06.739618+00:00, queued_by_job_id=1, pid=11163 2024-04-03T03:50:11.965298755Z [2024-04-03T03:50:11.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:50:11.965568306Z [2024-04-03T03:50:11.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:45:00+00:00, run_id=scheduled__2024-04-03T03:45:00+00:00, run_start_date=2024-04-03 03:50:00.532106+00:00, run_end_date=2024-04-03 03:50:11.965270+00:00, run_duration=11.433164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:45:00+00:00, data_interval_end=2024-04-03 03:50:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:50:11.974030811Z [2024-04-03T03:50:11.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:50:00+00:00, run_after=2024-04-03T03:55:00+00:00 2024-04-03T03:50:12.003632544Z [2024-04-03T03:50:12.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:45:00+00:00 exited with status success for try_number 1 2024-04-03T03:50:12.008511552Z [2024-04-03T03:50:12.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:45:00+00:00, map_index=-1, run_start_date=2024-04-03 03:50:11.467490+00:00, run_end_date=2024-04-03 03:50:11.805645+00:00, run_duration=0.338155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:50:09.653069+00:00, queued_by_job_id=1, pid=11184 2024-04-03T03:51:00.342039513Z [2024-04-03T03:51:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:51:00+00:00, run_after=2024-04-03T03:52:00+00:00 2024-04-03T03:51:00.349493183Z [2024-04-03T03:51:00.349+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:51:00.405768655Z [2024-04-03T03:51:00.405+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:51:00.405793323Z 2024-04-03T03:51:00.405797039Z 2024-04-03T03:51:00.405996464Z [2024-04-03T03:51:00.405+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:51:00.406302430Z [2024-04-03T03:51:00.406+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:51:00.407374900Z [2024-04-03T03:51:00.407+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:51:00.407389895Z 2024-04-03T03:51:00.407393694Z 2024-04-03T03:51:00.411595071Z [2024-04-03T03:51:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:51:00.411935521Z [2024-04-03T03:51:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:51:00.412387194Z [2024-04-03T03:51:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:51:00.412679209Z [2024-04-03T03:51:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:51:00.630418847Z [2024-04-03T03:51:00.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status queued for try_number 1 2024-04-03T03:51:00.630476377Z [2024-04-03T03:51:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status queued for try_number 1 2024-04-03T03:51:00.644756660Z [2024-04-03T03:51:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5166f0ec-561c-4e6b-96a9-ce0dc8271dea 2024-04-03T03:51:00.645023011Z [2024-04-03T03:51:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bd73480-83d9-47cf-867f-4b4cf50f5c8f 2024-04-03T03:51:03.964765870Z [2024-04-03T03:51:03.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:51:03.965015086Z [2024-04-03T03:51:03.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:50:00+00:00, run_id=scheduled__2024-04-03T03:50:00+00:00, run_start_date=2024-04-03 03:51:00.360463+00:00, run_end_date=2024-04-03 03:51:03.964675+00:00, run_duration=3.604212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:50:00+00:00, data_interval_end=2024-04-03 03:51:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:51:03.974127022Z [2024-04-03T03:51:03.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:51:00+00:00, run_after=2024-04-03T03:52:00+00:00 2024-04-03T03:51:04.013852880Z [2024-04-03T03:51:04.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status success for try_number 1 2024-04-03T03:51:04.019030771Z [2024-04-03T03:51:04.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:50:00+00:00, map_index=-1, run_start_date=2024-04-03 03:51:02.389533+00:00, run_end_date=2024-04-03 03:51:03.699709+00:00, run_duration=1.310176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:51:00.408309+00:00, queued_by_job_id=1, pid=11221 2024-04-03T03:51:05.063635990Z [2024-04-03T03:51:05.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:51:05.064087732Z [2024-04-03T03:51:05.063+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:50:00+00:00, run_id=scheduled__2024-04-03T03:50:00+00:00, run_start_date=2024-04-03 03:51:00.363018+00:00, run_end_date=2024-04-03 03:51:05.063459+00:00, run_duration=4.700441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:50:00+00:00, data_interval_end=2024-04-03 03:51:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:51:05.072845273Z [2024-04-03T03:51:05.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:51:00+00:00, run_after=2024-04-03T03:52:00+00:00 2024-04-03T03:51:05.103704203Z [2024-04-03T03:51:05.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status success for try_number 1 2024-04-03T03:51:05.109528500Z [2024-04-03T03:51:05.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:50:00+00:00, map_index=-1, run_start_date=2024-04-03 03:51:02.359806+00:00, run_end_date=2024-04-03 03:51:04.065226+00:00, run_duration=1.70542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:51:00.408309+00:00, queued_by_job_id=1, pid=11220 2024-04-03T03:51:36.395006269Z [2024-04-03T03:51:36.394+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:52:01.039517300Z [2024-04-03T03:52:01.039+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:52:01.047818227Z [2024-04-03T03:52:01.047+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:52:01.063802371Z [2024-04-03T03:52:01.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:52:00+00:00, run_after=2024-04-03T03:53:00+00:00 2024-04-03T03:52:01.137566694Z [2024-04-03T03:52:01.137+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:52:01.137591145Z 2024-04-03T03:52:01.137595206Z 2024-04-03T03:52:01.137598483Z 2024-04-03T03:52:01.137703061Z [2024-04-03T03:52:01.137+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:52:01.137835152Z [2024-04-03T03:52:01.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:52:01.137947078Z [2024-04-03T03:52:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:52:01.138581981Z [2024-04-03T03:52:01.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:52:01.138630156Z 2024-04-03T03:52:01.138635140Z 2024-04-03T03:52:01.138638400Z 2024-04-03T03:52:01.142099109Z [2024-04-03T03:52:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:52:01.142257567Z [2024-04-03T03:52:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:52:01.142539438Z [2024-04-03T03:52:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:52:01.142840510Z [2024-04-03T03:52:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:52:01.143489731Z [2024-04-03T03:52:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:52:01.143499399Z [2024-04-03T03:52:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:52:01.423079784Z [2024-04-03T03:52:01.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status queued for try_number 1 2024-04-03T03:52:01.423277255Z [2024-04-03T03:52:01.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:51:00+00:00 exited with status queued for try_number 1 2024-04-03T03:52:01.423468113Z [2024-04-03T03:52:01.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:51:00+00:00 exited with status queued for try_number 1 2024-04-03T03:52:01.433075172Z [2024-04-03T03:52:01.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d425351-7a1b-4137-bc4c-e525aa03506e 2024-04-03T03:52:01.433331752Z [2024-04-03T03:52:01.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to aadd02af-1be8-4d31-892e-290a3e0df6c9 2024-04-03T03:52:01.433498519Z [2024-04-03T03:52:01.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fa7b093-3b29-4bdd-be8c-eba4de027a57 2024-04-03T03:52:02.572342400Z [2024-04-03T03:52:02.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:52:02.572862514Z [2024-04-03T03:52:02.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:50:00+00:00, run_id=scheduled__2024-04-03T03:50:00+00:00, run_start_date=2024-04-03 03:52:01.077461+00:00, run_end_date=2024-04-03 03:52:02.572431+00:00, run_duration=1.49497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:50:00+00:00, data_interval_end=2024-04-03 03:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:52:02.580909057Z [2024-04-03T03:52:02.580+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:52:00+00:00, run_after=2024-04-03T03:54:00+00:00 2024-04-03T03:52:02.625942444Z [2024-04-03T03:52:02.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status success for try_number 1 2024-04-03T03:52:02.631172310Z [2024-04-03T03:52:02.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:50:00+00:00, map_index=-1, run_start_date=2024-04-03 03:52:02.107486+00:00, run_end_date=2024-04-03 03:52:02.459856+00:00, run_duration=0.35237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:52:01.139387+00:00, queued_by_job_id=1, pid=11255 2024-04-03T03:52:05.875031159Z [2024-04-03T03:52:05.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:52:05.875512996Z [2024-04-03T03:52:05.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:51:00+00:00, run_id=scheduled__2024-04-03T03:51:00+00:00, run_start_date=2024-04-03 03:52:01.080452+00:00, run_end_date=2024-04-03 03:52:05.874958+00:00, run_duration=4.794506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:51:00+00:00, data_interval_end=2024-04-03 03:52:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:52:05.886768445Z [2024-04-03T03:52:05.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:52:00+00:00, run_after=2024-04-03T03:53:00+00:00 2024-04-03T03:52:05.894228093Z [2024-04-03T03:52:05.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:52:05.895188536Z [2024-04-03T03:52:05.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:51:00+00:00, run_id=scheduled__2024-04-03T03:51:00+00:00, run_start_date=2024-04-03 03:52:01.079149+00:00, run_end_date=2024-04-03 03:52:05.894050+00:00, run_duration=4.814901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:51:00+00:00, data_interval_end=2024-04-03 03:52:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:52:05.905852557Z [2024-04-03T03:52:05.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:52:00+00:00, run_after=2024-04-03T03:53:00+00:00 2024-04-03T03:52:05.941090598Z [2024-04-03T03:52:05.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:51:00+00:00 exited with status success for try_number 1 2024-04-03T03:52:05.941359081Z [2024-04-03T03:52:05.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:51:00+00:00 exited with status success for try_number 1 2024-04-03T03:52:05.953677116Z [2024-04-03T03:52:05.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:51:00+00:00, map_index=-1, run_start_date=2024-04-03 03:52:03.276138+00:00, run_end_date=2024-04-03 03:52:04.870251+00:00, run_duration=1.594113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:52:01.139387+00:00, queued_by_job_id=1, pid=11286 2024-04-03T03:52:05.954912852Z [2024-04-03T03:52:05.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:51:00+00:00, map_index=-1, run_start_date=2024-04-03 03:52:03.197470+00:00, run_end_date=2024-04-03 03:52:05.241344+00:00, run_duration=2.043874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:52:01.139387+00:00, queued_by_job_id=1, pid=11285 2024-04-03T03:53:00.113099703Z [2024-04-03T03:53:00.112+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:53:00.127387257Z [2024-04-03T03:53:00.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:53:00+00:00, run_after=2024-04-03T03:54:00+00:00 2024-04-03T03:53:00.177917125Z [2024-04-03T03:53:00.177+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:53:00.177951407Z 2024-04-03T03:53:00.177955177Z 2024-04-03T03:53:00.177965376Z [2024-04-03T03:53:00.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:53:00.178066564Z [2024-04-03T03:53:00.177+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:53:00.178649027Z [2024-04-03T03:53:00.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:53:00.178669340Z 2024-04-03T03:53:00.178672941Z 2024-04-03T03:53:00.186994434Z [2024-04-03T03:53:00.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:53:00.187154915Z [2024-04-03T03:53:00.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:53:00.187356112Z [2024-04-03T03:53:00.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:53:00.187695386Z [2024-04-03T03:53:00.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:53:00.388656712Z [2024-04-03T03:53:00.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:52:00+00:00 exited with status queued for try_number 1 2024-04-03T03:53:00.388737081Z [2024-04-03T03:53:00.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:52:00+00:00 exited with status queued for try_number 1 2024-04-03T03:53:00.395441044Z [2024-04-03T03:53:00.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to c74f1858-8b3c-47f1-b329-973e0b3bf2b1 2024-04-03T03:53:00.395527307Z [2024-04-03T03:53:00.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 993c0497-4304-47ca-94b7-53269cba8ea8 2024-04-03T03:53:04.436332171Z [2024-04-03T03:53:04.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:53:04.436575945Z [2024-04-03T03:53:04.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:52:00+00:00, run_id=scheduled__2024-04-03T03:52:00+00:00, run_start_date=2024-04-03 03:53:00.139092+00:00, run_end_date=2024-04-03 03:53:04.436169+00:00, run_duration=4.297077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:52:00+00:00, data_interval_end=2024-04-03 03:53:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:53:04.447000642Z [2024-04-03T03:53:04.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:53:00+00:00, run_after=2024-04-03T03:54:00+00:00 2024-04-03T03:53:04.453761899Z [2024-04-03T03:53:04.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:53:04.453917481Z [2024-04-03T03:53:04.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:52:00+00:00, run_id=scheduled__2024-04-03T03:52:00+00:00, run_start_date=2024-04-03 03:53:00.140293+00:00, run_end_date=2024-04-03 03:53:04.453649+00:00, run_duration=4.313356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:52:00+00:00, data_interval_end=2024-04-03 03:53:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:53:04.463826572Z [2024-04-03T03:53:04.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:53:00+00:00, run_after=2024-04-03T03:54:00+00:00 2024-04-03T03:53:04.493402268Z [2024-04-03T03:53:04.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:52:00+00:00 exited with status success for try_number 1 2024-04-03T03:53:04.495174368Z [2024-04-03T03:53:04.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:52:00+00:00 exited with status success for try_number 1 2024-04-03T03:53:04.502024233Z [2024-04-03T03:53:04.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:52:00+00:00, map_index=-1, run_start_date=2024-04-03 03:53:02.306143+00:00, run_end_date=2024-04-03 03:53:03.841042+00:00, run_duration=1.534899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:53:00.179193+00:00, queued_by_job_id=1, pid=11340 2024-04-03T03:53:04.502292850Z [2024-04-03T03:53:04.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:52:00+00:00, map_index=-1, run_start_date=2024-04-03 03:53:02.216108+00:00, run_end_date=2024-04-03 03:53:04.164730+00:00, run_duration=1.948622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:53:00.179193+00:00, queued_by_job_id=1, pid=11339 2024-04-03T03:54:00.351946609Z [2024-04-03T03:54:00.351+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:54:00.362851891Z [2024-04-03T03:54:00.362+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:54:00.376987701Z [2024-04-03T03:54:00.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:54:00+00:00, run_after=2024-04-03T03:55:00+00:00 2024-04-03T03:54:00.445844053Z [2024-04-03T03:54:00.445+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:54:00.445867730Z 2024-04-03T03:54:00.445871692Z 2024-04-03T03:54:00.445874689Z 2024-04-03T03:54:00.445998655Z [2024-04-03T03:54:00.445+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:54:00.446140562Z [2024-04-03T03:54:00.446+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:54:00.446281356Z [2024-04-03T03:54:00.446+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:54:00.446869601Z [2024-04-03T03:54:00.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:54:00.446876402Z 2024-04-03T03:54:00.446879165Z 2024-04-03T03:54:00.446881930Z 2024-04-03T03:54:00.450293108Z [2024-04-03T03:54:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:54:00.450499115Z [2024-04-03T03:54:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:54:00.450915632Z [2024-04-03T03:54:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:54:00.451527280Z [2024-04-03T03:54:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:54:00.451809847Z [2024-04-03T03:54:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:54:00.451944350Z [2024-04-03T03:54:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:54:00.947557664Z [2024-04-03T03:54:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:52:00+00:00 exited with status queued for try_number 1 2024-04-03T03:54:00.947874193Z [2024-04-03T03:54:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:53:00+00:00 exited with status queued for try_number 1 2024-04-03T03:54:00.948082983Z [2024-04-03T03:54:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:53:00+00:00 exited with status queued for try_number 1 2024-04-03T03:54:00.977327618Z [2024-04-03T03:54:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9207395a-5175-4b19-8a1e-d2d65a989120 2024-04-03T03:54:00.985326400Z [2024-04-03T03:54:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to a73244f6-8851-46ad-8b40-170439f7bf45 2024-04-03T03:54:00.985744310Z [2024-04-03T03:54:00.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17511d0f-2162-4404-9b12-fa9528cb668d 2024-04-03T03:54:03.061575682Z [2024-04-03T03:54:03.061+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:54:03.065701744Z [2024-04-03T03:54:03.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:52:00+00:00, run_id=scheduled__2024-04-03T03:52:00+00:00, run_start_date=2024-04-03 03:54:00.391359+00:00, run_end_date=2024-04-03 03:54:03.065136+00:00, run_duration=2.673777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:52:00+00:00, data_interval_end=2024-04-03 03:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:54:03.100702347Z [2024-04-03T03:54:03.100+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:54:00+00:00, run_after=2024-04-03T03:56:00+00:00 2024-04-03T03:54:03.157480155Z [2024-04-03T03:54:03.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:52:00+00:00 exited with status success for try_number 1 2024-04-03T03:54:03.162648887Z [2024-04-03T03:54:03.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:52:00+00:00, map_index=-1, run_start_date=2024-04-03 03:54:01.694977+00:00, run_end_date=2024-04-03 03:54:02.439977+00:00, run_duration=0.745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:54:00.447594+00:00, queued_by_job_id=1, pid=11375 2024-04-03T03:54:05.303999441Z [2024-04-03T03:54:05.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:54:05.304199370Z [2024-04-03T03:54:05.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:53:00+00:00, run_id=scheduled__2024-04-03T03:53:00+00:00, run_start_date=2024-04-03 03:54:00.392652+00:00, run_end_date=2024-04-03 03:54:05.303811+00:00, run_duration=4.911159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:53:00+00:00, data_interval_end=2024-04-03 03:54:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:54:05.316091738Z [2024-04-03T03:54:05.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:54:00+00:00, run_after=2024-04-03T03:55:00+00:00 2024-04-03T03:54:05.354528206Z [2024-04-03T03:54:05.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:53:00+00:00 exited with status success for try_number 1 2024-04-03T03:54:05.359681209Z [2024-04-03T03:54:05.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:53:00+00:00, map_index=-1, run_start_date=2024-04-03 03:54:03.139541+00:00, run_end_date=2024-04-03 03:54:04.651694+00:00, run_duration=1.512153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:54:00.447594+00:00, queued_by_job_id=1, pid=11396 2024-04-03T03:54:06.413104391Z [2024-04-03T03:54:06.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:54:06.413829538Z [2024-04-03T03:54:06.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:53:00+00:00, run_id=scheduled__2024-04-03T03:53:00+00:00, run_start_date=2024-04-03 03:54:00.393649+00:00, run_end_date=2024-04-03 03:54:06.412977+00:00, run_duration=6.019328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:53:00+00:00, data_interval_end=2024-04-03 03:54:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:54:06.428061640Z [2024-04-03T03:54:06.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:54:00+00:00, run_after=2024-04-03T03:55:00+00:00 2024-04-03T03:54:06.464404491Z [2024-04-03T03:54:06.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:53:00+00:00 exited with status success for try_number 1 2024-04-03T03:54:06.473112913Z [2024-04-03T03:54:06.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:53:00+00:00, map_index=-1, run_start_date=2024-04-03 03:54:03.685990+00:00, run_end_date=2024-04-03 03:54:05.936283+00:00, run_duration=2.250293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:54:00.447594+00:00, queued_by_job_id=1, pid=11415 2024-04-03T03:55:00.609860914Z [2024-04-03T03:55:00.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:55:00+00:00, run_after=2024-04-03T03:56:00+00:00 2024-04-03T03:55:00.617623532Z [2024-04-03T03:55:00.617+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:55:00.630373359Z [2024-04-03T03:55:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:55:00+00:00, run_after=2024-04-03T04:00:00+00:00 2024-04-03T03:55:00.715943428Z [2024-04-03T03:55:00.715+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:55:00.715967675Z 2024-04-03T03:55:00.715971823Z 2024-04-03T03:55:00.715974947Z 2024-04-03T03:55:00.716259450Z [2024-04-03T03:55:00.716+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:55:00.718897049Z [2024-04-03T03:55:00.718+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:55:00.719132704Z [2024-04-03T03:55:00.719+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:55:00.719795140Z [2024-04-03T03:55:00.719+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:55:00.719804834Z 2024-04-03T03:55:00.719808199Z 2024-04-03T03:55:00.719811228Z 2024-04-03T03:55:00.727246011Z [2024-04-03T03:55:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T03:55:00.727622490Z [2024-04-03T03:55:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:55:00.727907380Z [2024-04-03T03:55:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:55:00.728068067Z [2024-04-03T03:55:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:55:00.728308362Z [2024-04-03T03:55:00.728+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:55:00.728457457Z [2024-04-03T03:55:00.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:55:01.192395304Z [2024-04-03T03:55:01.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status queued for try_number 1 2024-04-03T03:55:01.192427501Z [2024-04-03T03:55:01.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:54:00+00:00 exited with status queued for try_number 1 2024-04-03T03:55:01.192499437Z [2024-04-03T03:55:01.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:54:00+00:00 exited with status queued for try_number 1 2024-04-03T03:55:01.202682536Z [2024-04-03T03:55:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c567872-3efe-4d4c-8d96-c044c239f729 2024-04-03T03:55:01.202761666Z [2024-04-03T03:55:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e3751fd-57ef-4723-9653-1ef4c93838ce 2024-04-03T03:55:01.202876128Z [2024-04-03T03:55:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5bf9f1d-ccb8-4a90-b97c-d437acf6f906 2024-04-03T03:55:05.056033253Z [2024-04-03T03:55:05.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:55:05.056179090Z [2024-04-03T03:55:05.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:54:00+00:00, run_id=scheduled__2024-04-03T03:54:00+00:00, run_start_date=2024-04-03 03:55:00.649527+00:00, run_end_date=2024-04-03 03:55:05.055898+00:00, run_duration=4.406371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:54:00+00:00, data_interval_end=2024-04-03 03:55:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:55:05.066772617Z [2024-04-03T03:55:05.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:55:00+00:00, run_after=2024-04-03T03:56:00+00:00 2024-04-03T03:55:05.100030699Z [2024-04-03T03:55:05.099+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:55:05.100051158Z 2024-04-03T03:55:05.100306445Z [2024-04-03T03:55:05.100+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:55:05.101579408Z [2024-04-03T03:55:05.101+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:55:05.101614242Z 2024-04-03T03:55:05.104411353Z [2024-04-03T03:55:05.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T03:55:05.104515128Z [2024-04-03T03:55:05.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:55:05.199156827Z [2024-04-03T03:55:05.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status queued for try_number 1 2024-04-03T03:55:05.199184854Z [2024-04-03T03:55:05.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status success for try_number 1 2024-04-03T03:55:05.199244670Z [2024-04-03T03:55:05.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:54:00+00:00 exited with status success for try_number 1 2024-04-03T03:55:05.206550179Z [2024-04-03T03:55:05.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3487414-d48d-43d5-ab3a-9049e37add8f 2024-04-03T03:55:05.207070267Z [2024-04-03T03:55:05.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:50:00+00:00, map_index=-1, run_start_date=2024-04-03 03:55:03.944141+00:00, run_end_date=2024-04-03 03:55:04.314706+00:00, run_duration=0.370565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:55:00.720508+00:00, queued_by_job_id=1, pid=11490 2024-04-03T03:55:05.207473159Z [2024-04-03T03:55:05.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:54:00+00:00, map_index=-1, run_start_date=2024-04-03 03:55:03.407652+00:00, run_end_date=2024-04-03 03:55:04.989022+00:00, run_duration=1.58137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:55:00.720508+00:00, queued_by_job_id=1, pid=11462 2024-04-03T03:55:07.411784852Z [2024-04-03T03:55:07.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:55:07.412035935Z [2024-04-03T03:55:07.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:54:00+00:00, run_id=scheduled__2024-04-03T03:54:00+00:00, run_start_date=2024-04-03 03:55:00.650883+00:00, run_end_date=2024-04-03 03:55:07.411695+00:00, run_duration=6.760812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:54:00+00:00, data_interval_end=2024-04-03 03:55:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:55:07.421748671Z [2024-04-03T03:55:07.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:55:00+00:00, run_after=2024-04-03T03:56:00+00:00 2024-04-03T03:55:07.462666043Z [2024-04-03T03:55:07.462+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:55:07.462691247Z 2024-04-03T03:55:07.462867060Z [2024-04-03T03:55:07.462+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:55:07.463501715Z [2024-04-03T03:55:07.463+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:55:07.463507235Z 2024-04-03T03:55:07.466270780Z [2024-04-03T03:55:07.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T03:55:07.466429975Z [2024-04-03T03:55:07.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:55:07.517546022Z [2024-04-03T03:55:07.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status queued for try_number 1 2024-04-03T03:55:07.517831019Z [2024-04-03T03:55:07.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:54:00+00:00 exited with status success for try_number 1 2024-04-03T03:55:07.518043055Z [2024-04-03T03:55:07.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status success for try_number 1 2024-04-03T03:55:07.528736236Z [2024-04-03T03:55:07.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:50:00+00:00, map_index=-1, run_start_date=2024-04-03 03:55:06.841244+00:00, run_end_date=2024-04-03 03:55:07.131137+00:00, run_duration=0.289893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:55:05.101852+00:00, queued_by_job_id=1, pid=11512 2024-04-03T03:55:07.529118342Z [2024-04-03T03:55:07.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:54:00+00:00, map_index=-1, run_start_date=2024-04-03 03:55:03.494063+00:00, run_end_date=2024-04-03 03:55:06.383145+00:00, run_duration=2.889082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:55:00.720508+00:00, queued_by_job_id=1, pid=11463 2024-04-03T03:55:07.529396181Z [2024-04-03T03:55:07.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ebccefe-73dd-4395-9317-7d25c63735dc 2024-04-03T03:55:11.239326333Z [2024-04-03T03:55:11.238+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:55:11.239351419Z 2024-04-03T03:55:11.239737045Z [2024-04-03T03:55:11.239+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:55:11.240478761Z [2024-04-03T03:55:11.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:55:11.240490867Z 2024-04-03T03:55:11.242931373Z [2024-04-03T03:55:11.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:55:11.242987311Z [2024-04-03T03:55:11.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:55:11.298075149Z [2024-04-03T03:55:11.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status queued for try_number 1 2024-04-03T03:55:11.298095944Z [2024-04-03T03:55:11.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status success for try_number 1 2024-04-03T03:55:11.303477803Z [2024-04-03T03:55:11.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6eb6d353-f386-4e9f-976f-291dadb27bf1 2024-04-03T03:55:11.303584110Z [2024-04-03T03:55:11.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:50:00+00:00, map_index=0, run_start_date=2024-04-03 03:55:09.090007+00:00, run_end_date=2024-04-03 03:55:10.206090+00:00, run_duration=1.116083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:55:07.463929+00:00, queued_by_job_id=1, pid=11524 2024-04-03T03:55:13.497688936Z [2024-04-03T03:55:13.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:55:13.498212625Z [2024-04-03T03:55:13.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:50:00+00:00, run_id=scheduled__2024-04-03T03:50:00+00:00, run_start_date=2024-04-03 03:55:00.647837+00:00, run_end_date=2024-04-03 03:55:13.497596+00:00, run_duration=12.849759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:50:00+00:00, data_interval_end=2024-04-03 03:55:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T03:55:13.507928789Z [2024-04-03T03:55:13.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:55:00+00:00, run_after=2024-04-03T04:00:00+00:00 2024-04-03T03:55:13.539903367Z [2024-04-03T03:55:13.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:50:00+00:00 exited with status success for try_number 1 2024-04-03T03:55:13.553802568Z [2024-04-03T03:55:13.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:50:00+00:00, map_index=-1, run_start_date=2024-04-03 03:55:12.850704+00:00, run_end_date=2024-04-03 03:55:13.319046+00:00, run_duration=0.468342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:55:11.240961+00:00, queued_by_job_id=1, pid=11545 2024-04-03T03:56:00.939588062Z [2024-04-03T03:56:00.939+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:56:00.959367926Z [2024-04-03T03:56:00.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:56:00+00:00, run_after=2024-04-03T03:57:00+00:00 2024-04-03T03:56:00.969252553Z [2024-04-03T03:56:00.968+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:56:01.075336803Z [2024-04-03T03:56:01.074+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:56:01.075367604Z 2024-04-03T03:56:01.075371948Z 2024-04-03T03:56:01.075375561Z 2024-04-03T03:56:01.076224684Z [2024-04-03T03:56:01.075+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:56:01.076587027Z [2024-04-03T03:56:01.076+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:56:01.076973754Z [2024-04-03T03:56:01.076+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:56:01.078171285Z [2024-04-03T03:56:01.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:56:01.078193753Z 2024-04-03T03:56:01.078199797Z 2024-04-03T03:56:01.078204711Z 2024-04-03T03:56:01.084503190Z [2024-04-03T03:56:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:56:01.084843788Z [2024-04-03T03:56:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:56:01.085370680Z [2024-04-03T03:56:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:56:01.085638085Z [2024-04-03T03:56:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:56:01.086119069Z [2024-04-03T03:56:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:56:01.086426341Z [2024-04-03T03:56:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:56:01.546828357Z [2024-04-03T03:56:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:54:00+00:00 exited with status queued for try_number 1 2024-04-03T03:56:01.548687158Z [2024-04-03T03:56:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status queued for try_number 1 2024-04-03T03:56:01.548795611Z [2024-04-03T03:56:01.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status queued for try_number 1 2024-04-03T03:56:01.563965979Z [2024-04-03T03:56:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59ba0fb7-bf0f-4d4d-9852-f91a95cecbe2 2024-04-03T03:56:01.563996616Z [2024-04-03T03:56:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecb694b7-aa5b-4b89-acbe-97acde8ba9e0 2024-04-03T03:56:01.564129443Z [2024-04-03T03:56:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61c9d13f-3ec4-44d0-9e90-fca789daeece 2024-04-03T03:56:02.711767968Z [2024-04-03T03:56:02.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:56:02.713246709Z [2024-04-03T03:56:02.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:54:00+00:00, run_id=scheduled__2024-04-03T03:54:00+00:00, run_start_date=2024-04-03 03:56:00.982705+00:00, run_end_date=2024-04-03 03:56:02.712780+00:00, run_duration=1.730075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:54:00+00:00, data_interval_end=2024-04-03 03:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:56:02.723383810Z [2024-04-03T03:56:02.723+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:56:00+00:00, run_after=2024-04-03T03:58:00+00:00 2024-04-03T03:56:03.918014780Z [2024-04-03T03:56:03.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:54:00+00:00 exited with status success for try_number 1 2024-04-03T03:56:03.924720504Z [2024-04-03T03:56:03.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:54:00+00:00, map_index=-1, run_start_date=2024-04-03 03:56:02.179453+00:00, run_end_date=2024-04-03 03:56:02.690439+00:00, run_duration=0.510986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:56:01.080945+00:00, queued_by_job_id=1, pid=11562 2024-04-03T03:56:07.133222305Z [2024-04-03T03:56:07.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:56:07.133425367Z [2024-04-03T03:56:07.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:55:00+00:00, run_id=scheduled__2024-04-03T03:55:00+00:00, run_start_date=2024-04-03 03:56:00.985765+00:00, run_end_date=2024-04-03 03:56:07.133086+00:00, run_duration=6.147321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:55:00+00:00, data_interval_end=2024-04-03 03:56:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:56:07.145372261Z [2024-04-03T03:56:07.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:56:00+00:00, run_after=2024-04-03T03:57:00+00:00 2024-04-03T03:56:07.155805445Z [2024-04-03T03:56:07.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:56:07.156504632Z [2024-04-03T03:56:07.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:55:00+00:00, run_id=scheduled__2024-04-03T03:55:00+00:00, run_start_date=2024-04-03 03:56:00.984413+00:00, run_end_date=2024-04-03 03:56:07.155916+00:00, run_duration=6.171503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:55:00+00:00, data_interval_end=2024-04-03 03:56:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:56:07.178921343Z [2024-04-03T03:56:07.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:56:00+00:00, run_after=2024-04-03T03:57:00+00:00 2024-04-03T03:56:07.212242264Z [2024-04-03T03:56:07.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status success for try_number 1 2024-04-03T03:56:07.212266897Z [2024-04-03T03:56:07.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status success for try_number 1 2024-04-03T03:56:07.219950294Z [2024-04-03T03:56:07.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:55:00+00:00, map_index=-1, run_start_date=2024-04-03 03:56:03.673623+00:00, run_end_date=2024-04-03 03:56:06.710459+00:00, run_duration=3.036836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:56:01.080945+00:00, queued_by_job_id=1, pid=11593 2024-04-03T03:56:07.220131532Z [2024-04-03T03:56:07.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:55:00+00:00, map_index=-1, run_start_date=2024-04-03 03:56:03.611470+00:00, run_end_date=2024-04-03 03:56:06.037146+00:00, run_duration=2.425676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:56:01.080945+00:00, queued_by_job_id=1, pid=11592 2024-04-03T03:56:36.469519990Z [2024-04-03T03:56:36.468+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T03:56:46.823863416Z [2024-04-03T03:56:46.823+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T03:56:46.823900487Z 2024-04-03T03:56:46.823907207Z [2024-04-03T03:56:46.823+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-03T03:56:46.824613971Z [2024-04-03T03:56:46.824+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:56:46.824640388Z 2024-04-03T03:56:46.827113288Z [2024-04-03T03:56:46.826+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240403035645_088555', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:56:46.827329788Z [2024-04-03T03:56:46.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240403035645_088555', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-03T03:56:46.874616548Z [2024-04-03T03:56:46.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240403035645_088555 exited with status queued for try_number 1 2024-04-03T03:56:46.878879748Z [2024-04-03T03:56:46.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to 885ec638-0556-4be5-9952-bb978ddc26c9 2024-04-03T03:56:47.995281166Z [2024-04-03T03:56:47.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:56:47.995685785Z [2024-04-03T03:56:47.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-03 03:56:46.133909+00:00, run_id=vdu_alarm_20240403035645_088555, run_start_date=2024-04-03 03:56:46.791776+00:00, run_end_date=2024-04-03 03:56:47.995197+00:00, run_duration=1.203421, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-03 03:56:46.133909+00:00, data_interval_end=2024-04-03 03:56:46.133909+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-03T03:56:47.999267683Z [2024-04-03T03:56:47.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-03T03:56:48.037819948Z [2024-04-03T03:56:48.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240403035645_088555 exited with status success for try_number 1 2024-04-03T03:56:48.042408729Z [2024-04-03T03:56:48.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240403035645_088555, map_index=-1, run_start_date=2024-04-03 03:56:47.464830+00:00, run_end_date=2024-04-03 03:56:47.875089+00:00, run_duration=0.410259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:56:46.824971+00:00, queued_by_job_id=1, pid=11625 2024-04-03T03:57:00.947015093Z [2024-04-03T03:57:00.946+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:57:00.966559524Z [2024-04-03T03:57:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:57:00+00:00, run_after=2024-04-03T03:58:00+00:00 2024-04-03T03:57:01.047132731Z [2024-04-03T03:57:01.046+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:57:01.047153875Z 2024-04-03T03:57:01.047157800Z 2024-04-03T03:57:01.047337409Z [2024-04-03T03:57:01.047+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:57:01.047506504Z [2024-04-03T03:57:01.047+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:57:01.048068340Z [2024-04-03T03:57:01.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:57:01.048080336Z 2024-04-03T03:57:01.048083849Z 2024-04-03T03:57:01.051199534Z [2024-04-03T03:57:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:57:01.051380821Z [2024-04-03T03:57:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:57:01.051673335Z [2024-04-03T03:57:01.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:57:01.051818764Z [2024-04-03T03:57:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:57:01.304915110Z [2024-04-03T03:57:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:56:00+00:00 exited with status queued for try_number 1 2024-04-03T03:57:01.305166754Z [2024-04-03T03:57:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:56:00+00:00 exited with status queued for try_number 1 2024-04-03T03:57:01.313824888Z [2024-04-03T03:57:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3859d36-8e33-4b33-bd9b-1b6475e39ab6 2024-04-03T03:57:01.314039247Z [2024-04-03T03:57:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 178d02a8-b94a-4ef7-8532-34aa65a56346 2024-04-03T03:57:05.767207123Z [2024-04-03T03:57:05.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:57:05.767511450Z [2024-04-03T03:57:05.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:56:00+00:00, run_id=scheduled__2024-04-03T03:56:00+00:00, run_start_date=2024-04-03 03:57:00.984316+00:00, run_end_date=2024-04-03 03:57:05.767130+00:00, run_duration=4.782814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:56:00+00:00, data_interval_end=2024-04-03 03:57:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:57:05.781461476Z [2024-04-03T03:57:05.781+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:57:00+00:00, run_after=2024-04-03T03:58:00+00:00 2024-04-03T03:57:05.819904318Z [2024-04-03T03:57:05.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:56:00+00:00 exited with status success for try_number 1 2024-04-03T03:57:05.825203186Z [2024-04-03T03:57:05.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:56:00+00:00, map_index=-1, run_start_date=2024-04-03 03:57:03.062314+00:00, run_end_date=2024-04-03 03:57:05.436054+00:00, run_duration=2.37374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:57:01.048754+00:00, queued_by_job_id=1, pid=11657 2024-04-03T03:57:06.392877650Z [2024-04-03T03:57:06.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:57:06.393267567Z [2024-04-03T03:57:06.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:56:00+00:00, run_id=scheduled__2024-04-03T03:56:00+00:00, run_start_date=2024-04-03 03:57:00.986659+00:00, run_end_date=2024-04-03 03:57:06.392725+00:00, run_duration=5.406066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:56:00+00:00, data_interval_end=2024-04-03 03:57:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:57:06.402440407Z [2024-04-03T03:57:06.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:57:00+00:00, run_after=2024-04-03T03:58:00+00:00 2024-04-03T03:57:06.446332540Z [2024-04-03T03:57:06.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:56:00+00:00 exited with status success for try_number 1 2024-04-03T03:57:06.457537168Z [2024-04-03T03:57:06.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:56:00+00:00, map_index=-1, run_start_date=2024-04-03 03:57:03.052645+00:00, run_end_date=2024-04-03 03:57:05.966496+00:00, run_duration=2.913851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:57:01.048754+00:00, queued_by_job_id=1, pid=11658 2024-04-03T03:58:00.271329372Z [2024-04-03T03:58:00.270+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:58:00.279371648Z [2024-04-03T03:58:00.279+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:58:00.295315572Z [2024-04-03T03:58:00.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:58:00+00:00, run_after=2024-04-03T03:59:00+00:00 2024-04-03T03:58:00.357999909Z [2024-04-03T03:58:00.357+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T03:58:00.358036304Z 2024-04-03T03:58:00.358040825Z 2024-04-03T03:58:00.358044004Z 2024-04-03T03:58:00.358107869Z [2024-04-03T03:58:00.357+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T03:58:00.358137948Z [2024-04-03T03:58:00.358+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:58:00.358229216Z [2024-04-03T03:58:00.358+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:58:00.359013048Z [2024-04-03T03:58:00.358+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:58:00.359024468Z 2024-04-03T03:58:00.359028749Z 2024-04-03T03:58:00.359031901Z 2024-04-03T03:58:00.362314577Z [2024-04-03T03:58:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:58:00.362482889Z [2024-04-03T03:58:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:58:00.362794211Z [2024-04-03T03:58:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:58:00.362988004Z [2024-04-03T03:58:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:58:00.363299046Z [2024-04-03T03:58:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:58:00.364294645Z [2024-04-03T03:58:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:58:00.696106455Z [2024-04-03T03:58:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:56:00+00:00 exited with status queued for try_number 1 2024-04-03T03:58:00.696164110Z [2024-04-03T03:58:00.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:57:00+00:00 exited with status queued for try_number 1 2024-04-03T03:58:00.696521906Z [2024-04-03T03:58:00.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:57:00+00:00 exited with status queued for try_number 1 2024-04-03T03:58:00.706267868Z [2024-04-03T03:58:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5bd9f81-1298-4b75-b0d9-62fbb9d8e568 2024-04-03T03:58:00.706628100Z [2024-04-03T03:58:00.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29327d7c-931a-425d-a39b-cc9819375088 2024-04-03T03:58:00.707484645Z [2024-04-03T03:58:00.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to bee70475-bfd3-4f2e-a065-edd4d5a47a6f 2024-04-03T03:58:04.545618431Z [2024-04-03T03:58:04.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:58:04.546342429Z [2024-04-03T03:58:04.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:56:00+00:00, run_id=scheduled__2024-04-03T03:56:00+00:00, run_start_date=2024-04-03 03:58:00.306655+00:00, run_end_date=2024-04-03 03:58:04.545813+00:00, run_duration=4.239158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:56:00+00:00, data_interval_end=2024-04-03 03:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T03:58:04.558133818Z [2024-04-03T03:58:04.557+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T03:58:00+00:00, run_after=2024-04-03T04:00:00+00:00 2024-04-03T03:58:04.645119204Z [2024-04-03T03:58:04.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:56:00+00:00 exited with status success for try_number 1 2024-04-03T03:58:04.652185064Z [2024-04-03T03:58:04.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:56:00+00:00, map_index=-1, run_start_date=2024-04-03 03:58:02.384315+00:00, run_end_date=2024-04-03 03:58:03.568840+00:00, run_duration=1.184525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:58:00.359687+00:00, queued_by_job_id=1, pid=11695 2024-04-03T03:58:07.350636216Z [2024-04-03T03:58:07.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:58:07.350915996Z [2024-04-03T03:58:07.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:57:00+00:00, run_id=scheduled__2024-04-03T03:57:00+00:00, run_start_date=2024-04-03 03:58:00.307792+00:00, run_end_date=2024-04-03 03:58:07.350524+00:00, run_duration=7.042732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:57:00+00:00, data_interval_end=2024-04-03 03:58:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:58:07.360286019Z [2024-04-03T03:58:07.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:58:00+00:00, run_after=2024-04-03T03:59:00+00:00 2024-04-03T03:58:07.367448936Z [2024-04-03T03:58:07.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:58:07.367727050Z [2024-04-03T03:58:07.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:57:00+00:00, run_id=scheduled__2024-04-03T03:57:00+00:00, run_start_date=2024-04-03 03:58:00.308840+00:00, run_end_date=2024-04-03 03:58:07.367373+00:00, run_duration=7.058533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:57:00+00:00, data_interval_end=2024-04-03 03:58:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:58:07.377797885Z [2024-04-03T03:58:07.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:58:00+00:00, run_after=2024-04-03T03:59:00+00:00 2024-04-03T03:58:07.413915201Z [2024-04-03T03:58:07.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:57:00+00:00 exited with status success for try_number 1 2024-04-03T03:58:07.413996827Z [2024-04-03T03:58:07.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:57:00+00:00 exited with status success for try_number 1 2024-04-03T03:58:07.420608120Z [2024-04-03T03:58:07.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:57:00+00:00, map_index=-1, run_start_date=2024-04-03 03:58:04.343453+00:00, run_end_date=2024-04-03 03:58:06.689055+00:00, run_duration=2.345602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:58:00.359687+00:00, queued_by_job_id=1, pid=11724 2024-04-03T03:58:07.420785773Z [2024-04-03T03:58:07.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:57:00+00:00, map_index=-1, run_start_date=2024-04-03 03:58:04.175396+00:00, run_end_date=2024-04-03 03:58:06.960182+00:00, run_duration=2.784786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:58:00.359687+00:00, queued_by_job_id=1, pid=11723 2024-04-03T03:59:00.191319091Z [2024-04-03T03:59:00.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:59:00+00:00, run_after=2024-04-03T04:00:00+00:00 2024-04-03T03:59:00.205219994Z [2024-04-03T03:59:00.204+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T03:59:00.260920179Z [2024-04-03T03:59:00.260+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T03:59:00.260946436Z 2024-04-03T03:59:00.260950055Z 2024-04-03T03:59:00.261002862Z [2024-04-03T03:59:00.260+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:59:00.261007197Z [2024-04-03T03:59:00.260+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T03:59:00.261821630Z [2024-04-03T03:59:00.261+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T03:59:00.261885170Z 2024-04-03T03:59:00.261889141Z 2024-04-03T03:59:00.265465600Z [2024-04-03T03:59:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:59:00.265550927Z [2024-04-03T03:59:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:59:00.265866184Z [2024-04-03T03:59:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T03:59:00.265970178Z [2024-04-03T03:59:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:59:00.527859536Z [2024-04-03T03:59:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:58:00+00:00 exited with status queued for try_number 1 2024-04-03T03:59:00.527980033Z [2024-04-03T03:59:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:58:00+00:00 exited with status queued for try_number 1 2024-04-03T03:59:00.534693158Z [2024-04-03T03:59:00.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7c3da90-a8e5-4737-bea5-4850b72c96d6 2024-04-03T03:59:00.534790710Z [2024-04-03T03:59:00.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 090c3776-f4b6-4dc3-8180-510f9f76e0ef 2024-04-03T03:59:05.470577860Z [2024-04-03T03:59:05.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:59:05.471065707Z [2024-04-03T03:59:05.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:58:00+00:00, run_id=scheduled__2024-04-03T03:58:00+00:00, run_start_date=2024-04-03 03:59:00.216147+00:00, run_end_date=2024-04-03 03:59:05.470685+00:00, run_duration=5.254538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:58:00+00:00, data_interval_end=2024-04-03 03:59:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T03:59:05.479778042Z [2024-04-03T03:59:05.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:59:00+00:00, run_after=2024-04-03T04:00:00+00:00 2024-04-03T03:59:05.513258160Z [2024-04-03T03:59:05.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:58:00+00:00 exited with status success for try_number 1 2024-04-03T03:59:05.517559226Z [2024-04-03T03:59:05.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:58:00+00:00, map_index=-1, run_start_date=2024-04-03 03:59:02.821429+00:00, run_end_date=2024-04-03 03:59:04.937599+00:00, run_duration=2.11617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:59:00.262324+00:00, queued_by_job_id=1, pid=11780 2024-04-03T03:59:06.573402496Z [2024-04-03T03:59:06.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T03:59:06.573629964Z [2024-04-03T03:59:06.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:58:00+00:00, run_id=scheduled__2024-04-03T03:58:00+00:00, run_start_date=2024-04-03 03:59:00.217342+00:00, run_end_date=2024-04-03 03:59:06.573340+00:00, run_duration=6.355998, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:58:00+00:00, data_interval_end=2024-04-03 03:59:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T03:59:06.588521428Z [2024-04-03T03:59:06.588+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T03:59:00+00:00, run_after=2024-04-03T04:00:00+00:00 2024-04-03T03:59:06.630737028Z [2024-04-03T03:59:06.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:58:00+00:00 exited with status success for try_number 1 2024-04-03T03:59:06.635529779Z [2024-04-03T03:59:06.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:58:00+00:00, map_index=-1, run_start_date=2024-04-03 03:59:02.776402+00:00, run_end_date=2024-04-03 03:59:05.750738+00:00, run_duration=2.974336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 03:59:00.262324+00:00, queued_by_job_id=1, pid=11779 2024-04-03T04:00:00.170270079Z [2024-04-03T04:00:00.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:00:00+00:00, run_after=2024-04-03T04:05:00+00:00 2024-04-03T04:00:00.190116355Z [2024-04-03T04:00:00.187+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:00:00.196690813Z [2024-04-03T04:00:00.196+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:00:00.219716602Z [2024-04-03T04:00:00.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:00:00+00:00, run_after=2024-04-03T04:01:00+00:00 2024-04-03T04:00:00.343511716Z [2024-04-03T04:00:00.343+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T04:00:00.343550576Z 2024-04-03T04:00:00.343554396Z 2024-04-03T04:00:00.343558522Z 2024-04-03T04:00:00.343570994Z 2024-04-03T04:00:00.344329545Z [2024-04-03T04:00:00.343+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:00:00.344635416Z [2024-04-03T04:00:00.344+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:00:00.344936567Z [2024-04-03T04:00:00.344+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:00:00.345556048Z [2024-04-03T04:00:00.345+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:00:00.346373537Z [2024-04-03T04:00:00.346+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:00:00.346410591Z 2024-04-03T04:00:00.346415648Z 2024-04-03T04:00:00.346419188Z 2024-04-03T04:00:00.346422437Z 2024-04-03T04:00:00.354963029Z [2024-04-03T04:00:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T04:00:00.355197624Z [2024-04-03T04:00:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:00:00.355593910Z [2024-04-03T04:00:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:00:00.355830515Z [2024-04-03T04:00:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:00:00.356111612Z [2024-04-03T04:00:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:00:00.356304533Z [2024-04-03T04:00:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:00:00.356631272Z [2024-04-03T04:00:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:00:00.356823774Z [2024-04-03T04:00:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:00:00.732357965Z [2024-04-03T04:00:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status queued for try_number 1 2024-04-03T04:00:00.734497585Z [2024-04-03T04:00:00.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:58:00+00:00 exited with status queued for try_number 1 2024-04-03T04:00:00.736865141Z [2024-04-03T04:00:00.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:59:00+00:00 exited with status queued for try_number 1 2024-04-03T04:00:00.737053638Z [2024-04-03T04:00:00.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:59:00+00:00 exited with status queued for try_number 1 2024-04-03T04:00:00.748948853Z [2024-04-03T04:00:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7db9f98-d51b-4094-a0ad-42a607f44154 2024-04-03T04:00:00.748975191Z [2024-04-03T04:00:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d9089d7-61eb-494e-9bdc-03ba36809057 2024-04-03T04:00:00.748979056Z [2024-04-03T04:00:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd37e228-a787-48ae-a15b-110c844ba8cf 2024-04-03T04:00:00.750732950Z [2024-04-03T04:00:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91ee8f67-13cd-4a63-81d4-4b24c4e4ddd8 2024-04-03T04:00:03.702982918Z [2024-04-03T04:00:03.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:00:03.703609500Z [2024-04-03T04:00:03.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 03:58:00+00:00, run_id=scheduled__2024-04-03T03:58:00+00:00, run_start_date=2024-04-03 04:00:00.242506+00:00, run_end_date=2024-04-03 04:00:03.702910+00:00, run_duration=3.460404, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:58:00+00:00, data_interval_end=2024-04-03 04:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:00:03.713690568Z [2024-04-03T04:00:03.712+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:00:00+00:00, run_after=2024-04-03T04:02:00+00:00 2024-04-03T04:00:03.806645823Z [2024-04-03T04:00:03.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T03:58:00+00:00 exited with status success for try_number 1 2024-04-03T04:00:03.821902620Z [2024-04-03T04:00:03.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T03:58:00+00:00, map_index=-1, run_start_date=2024-04-03 04:00:02.339529+00:00, run_end_date=2024-04-03 04:00:02.949962+00:00, run_duration=0.610433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:00:00.351354+00:00, queued_by_job_id=1, pid=11819 2024-04-03T04:00:05.385597410Z [2024-04-03T04:00:05.385+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:00:05.385628695Z 2024-04-03T04:00:05.385640559Z [2024-04-03T04:00:05.385+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:00:05.386563076Z [2024-04-03T04:00:05.386+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:00:05.386585116Z 2024-04-03T04:00:05.389580804Z [2024-04-03T04:00:05.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T04:00:05.389793904Z [2024-04-03T04:00:05.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:00:05.441389607Z [2024-04-03T04:00:05.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status queued for try_number 1 2024-04-03T04:00:05.441414765Z [2024-04-03T04:00:05.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status success for try_number 1 2024-04-03T04:00:05.447240230Z [2024-04-03T04:00:05.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7d74f40-d984-4ba9-a1cd-bd3d09ea9b17 2024-04-03T04:00:05.447458498Z [2024-04-03T04:00:05.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T03:55:00+00:00, map_index=-1, run_start_date=2024-04-03 04:00:03.581466+00:00, run_end_date=2024-04-03 04:00:04.326372+00:00, run_duration=0.744906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:00:00.351354+00:00, queued_by_job_id=1, pid=11851 2024-04-03T04:00:06.602011824Z [2024-04-03T04:00:06.601+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:00:06.602341908Z [2024-04-03T04:00:06.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:59:00+00:00, run_id=scheduled__2024-04-03T03:59:00+00:00, run_start_date=2024-04-03 04:00:00.244478+00:00, run_end_date=2024-04-03 04:00:06.601752+00:00, run_duration=6.357274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:59:00+00:00, data_interval_end=2024-04-03 04:00:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:00:06.622584260Z [2024-04-03T04:00:06.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:00:00+00:00, run_after=2024-04-03T04:01:00+00:00 2024-04-03T04:00:06.644700713Z [2024-04-03T04:00:06.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:00:06.644740497Z [2024-04-03T04:00:06.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:59:00+00:00, run_id=scheduled__2024-04-03T03:59:00+00:00, run_start_date=2024-04-03 04:00:00.243551+00:00, run_end_date=2024-04-03 04:00:06.637165+00:00, run_duration=6.393614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:59:00+00:00, data_interval_end=2024-04-03 04:00:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:00:06.655411653Z [2024-04-03T04:00:06.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:00:00+00:00, run_after=2024-04-03T04:01:00+00:00 2024-04-03T04:00:06.725631760Z [2024-04-03T04:00:06.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:59:00+00:00 exited with status success for try_number 1 2024-04-03T04:00:06.725674107Z [2024-04-03T04:00:06.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T03:59:00+00:00 exited with status success for try_number 1 2024-04-03T04:00:06.739275466Z [2024-04-03T04:00:06.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:59:00+00:00, map_index=-1, run_start_date=2024-04-03 04:00:04.009441+00:00, run_end_date=2024-04-03 04:00:06.309045+00:00, run_duration=2.299604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:00:00.351354+00:00, queued_by_job_id=1, pid=11859 2024-04-03T04:00:06.739311371Z [2024-04-03T04:00:06.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T03:59:00+00:00, map_index=-1, run_start_date=2024-04-03 04:00:03.588334+00:00, run_end_date=2024-04-03 04:00:05.612470+00:00, run_duration=2.024136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:00:00.351354+00:00, queued_by_job_id=1, pid=11849 2024-04-03T04:00:07.805021972Z [2024-04-03T04:00:07.804+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:00:07.805063086Z 2024-04-03T04:00:07.805109398Z [2024-04-03T04:00:07.804+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:00:07.805596334Z [2024-04-03T04:00:07.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:00:07.805603728Z 2024-04-03T04:00:07.808067692Z [2024-04-03T04:00:07.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T03:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T04:00:07.808129164Z [2024-04-03T04:00:07.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:00:07.859884095Z [2024-04-03T04:00:07.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status queued for try_number 1 2024-04-03T04:00:07.859962830Z [2024-04-03T04:00:07.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status success for try_number 1 2024-04-03T04:00:07.867341085Z [2024-04-03T04:00:07.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3b97c65-247d-4a58-8087-6571c75b797f 2024-04-03T04:00:07.867587769Z [2024-04-03T04:00:07.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T03:55:00+00:00, map_index=-1, run_start_date=2024-04-03 04:00:07.141658+00:00, run_end_date=2024-04-03 04:00:07.476753+00:00, run_duration=0.335095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:00:05.387105+00:00, queued_by_job_id=1, pid=11898 2024-04-03T04:00:10.487671054Z [2024-04-03T04:00:10.487+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:00:10.487705789Z 2024-04-03T04:00:10.487710041Z [2024-04-03T04:00:10.487+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:00:10.491082075Z [2024-04-03T04:00:10.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:00:10.491104386Z 2024-04-03T04:00:10.495924315Z [2024-04-03T04:00:10.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:00:10.495951097Z [2024-04-03T04:00:10.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:00:10.587447561Z [2024-04-03T04:00:10.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status queued for try_number 1 2024-04-03T04:00:10.587468241Z [2024-04-03T04:00:10.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status success for try_number 1 2024-04-03T04:00:10.612669154Z [2024-04-03T04:00:10.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e337720-c154-45b4-97de-f52efd313102 2024-04-03T04:00:10.615917843Z [2024-04-03T04:00:10.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T03:55:00+00:00, map_index=0, run_start_date=2024-04-03 04:00:09.608886+00:00, run_end_date=2024-04-03 04:00:10.018229+00:00, run_duration=0.409343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:00:07.805928+00:00, queued_by_job_id=1, pid=11910 2024-04-03T04:00:13.520919441Z [2024-04-03T04:00:13.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:00:13.521361676Z [2024-04-03T04:00:13.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 03:55:00+00:00, run_id=scheduled__2024-04-03T03:55:00+00:00, run_start_date=2024-04-03 04:00:00.239950+00:00, run_end_date=2024-04-03 04:00:13.520971+00:00, run_duration=13.281021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 03:55:00+00:00, data_interval_end=2024-04-03 04:00:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T04:00:13.529098801Z [2024-04-03T04:00:13.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:00:00+00:00, run_after=2024-04-03T04:05:00+00:00 2024-04-03T04:00:13.562709672Z [2024-04-03T04:00:13.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T03:55:00+00:00 exited with status success for try_number 1 2024-04-03T04:00:13.568945384Z [2024-04-03T04:00:13.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T03:55:00+00:00, map_index=-1, run_start_date=2024-04-03 04:00:12.561759+00:00, run_end_date=2024-04-03 04:00:13.033866+00:00, run_duration=0.472107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:00:10.491468+00:00, queued_by_job_id=1, pid=11922 2024-04-03T04:00:46.571694900Z [2024-04-03T04:00:46.571+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:00:46.571730180Z 2024-04-03T04:00:46.571987632Z [2024-04-03T04:00:46.571+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-03T04:00:46.572952985Z [2024-04-03T04:00:46.572+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:00:46.572968112Z 2024-04-03T04:00:46.576081622Z [2024-04-03T04:00:46.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240403040045_061091', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:00:46.576273092Z [2024-04-03T04:00:46.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240403040045_061091', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-03T04:00:46.640697812Z [2024-04-03T04:00:46.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240403040045_061091 exited with status queued for try_number 1 2024-04-03T04:00:46.645109182Z [2024-04-03T04:00:46.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79b1e73b-00fd-4c6e-8c19-686a5f213238 2024-04-03T04:00:48.868969964Z [2024-04-03T04:00:48.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:00:48.869231573Z [2024-04-03T04:00:48.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-03 04:00:46.118815+00:00, run_id=vdu_alarm_20240403040045_061091, run_start_date=2024-04-03 04:00:46.525776+00:00, run_end_date=2024-04-03 04:00:48.868873+00:00, run_duration=2.343097, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-03 04:00:46.118815+00:00, data_interval_end=2024-04-03 04:00:46.118815+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-03T04:00:48.872260545Z [2024-04-03T04:00:48.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-03T04:00:48.902309914Z [2024-04-03T04:00:48.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240403040045_061091 exited with status success for try_number 1 2024-04-03T04:00:48.909069366Z [2024-04-03T04:00:48.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240403040045_061091, map_index=-1, run_start_date=2024-04-03 04:00:47.327470+00:00, run_end_date=2024-04-03 04:00:47.690428+00:00, run_duration=0.362958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:00:46.573411+00:00, queued_by_job_id=1, pid=11937 2024-04-03T04:01:01.135028742Z [2024-04-03T04:01:01.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:01:00+00:00, run_after=2024-04-03T04:02:00+00:00 2024-04-03T04:01:01.153371183Z [2024-04-03T04:01:01.153+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:01:01.279167185Z [2024-04-03T04:01:01.278+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:01:01.279194030Z 2024-04-03T04:01:01.279197751Z 2024-04-03T04:01:01.279246138Z [2024-04-03T04:01:01.279+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:01:01.279250273Z [2024-04-03T04:01:01.279+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:01:01.279805115Z [2024-04-03T04:01:01.279+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:01:01.279814454Z 2024-04-03T04:01:01.279817874Z 2024-04-03T04:01:01.288299457Z [2024-04-03T04:01:01.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:01:01.288485058Z [2024-04-03T04:01:01.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:01:01.288723601Z [2024-04-03T04:01:01.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:01:01.288824150Z [2024-04-03T04:01:01.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:01:01.499959146Z [2024-04-03T04:01:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status queued for try_number 1 2024-04-03T04:01:01.500028526Z [2024-04-03T04:01:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status queued for try_number 1 2024-04-03T04:01:01.512185812Z [2024-04-03T04:01:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e7ea96d-43a2-4744-9892-a7a278c5646a 2024-04-03T04:01:01.513376624Z [2024-04-03T04:01:01.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to da2d92d0-ba88-4b4c-a424-d3319ccc6992 2024-04-03T04:01:06.219969100Z [2024-04-03T04:01:06.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:01:06.220445050Z [2024-04-03T04:01:06.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:00:00+00:00, run_id=scheduled__2024-04-03T04:00:00+00:00, run_start_date=2024-04-03 04:01:01.168381+00:00, run_end_date=2024-04-03 04:01:06.219875+00:00, run_duration=5.051494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:00:00+00:00, data_interval_end=2024-04-03 04:01:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:01:06.230276658Z [2024-04-03T04:01:06.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:01:00+00:00, run_after=2024-04-03T04:02:00+00:00 2024-04-03T04:01:06.274044625Z [2024-04-03T04:01:06.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status success for try_number 1 2024-04-03T04:01:06.279709387Z [2024-04-03T04:01:06.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:00:00+00:00, map_index=-1, run_start_date=2024-04-03 04:01:03.311084+00:00, run_end_date=2024-04-03 04:01:05.335770+00:00, run_duration=2.024686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:01:01.280318+00:00, queued_by_job_id=1, pid=11970 2024-04-03T04:01:07.314705970Z [2024-04-03T04:01:07.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:01:07.314805408Z [2024-04-03T04:01:07.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:00:00+00:00, run_id=scheduled__2024-04-03T04:00:00+00:00, run_start_date=2024-04-03 04:01:01.169730+00:00, run_end_date=2024-04-03 04:01:07.314507+00:00, run_duration=6.144777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:00:00+00:00, data_interval_end=2024-04-03 04:01:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:01:07.324786270Z [2024-04-03T04:01:07.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:01:00+00:00, run_after=2024-04-03T04:02:00+00:00 2024-04-03T04:01:07.348547045Z [2024-04-03T04:01:07.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status success for try_number 1 2024-04-03T04:01:07.352909923Z [2024-04-03T04:01:07.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:00:00+00:00, map_index=-1, run_start_date=2024-04-03 04:01:03.123185+00:00, run_end_date=2024-04-03 04:01:06.225049+00:00, run_duration=3.101864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:01:01.280318+00:00, queued_by_job_id=1, pid=11969 2024-04-03T04:01:36.521810734Z [2024-04-03T04:01:36.521+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T04:02:00.075368298Z [2024-04-03T04:02:00.074+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:02:00.089008982Z [2024-04-03T04:02:00.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:02:00+00:00, run_after=2024-04-03T04:03:00+00:00 2024-04-03T04:02:00.095918066Z [2024-04-03T04:02:00.095+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:02:00.155272776Z [2024-04-03T04:02:00.152+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:02:00.155295605Z 2024-04-03T04:02:00.155313814Z 2024-04-03T04:02:00.155318949Z 2024-04-03T04:02:00.155325476Z [2024-04-03T04:02:00.152+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:02:00.155330681Z [2024-04-03T04:02:00.152+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:02:00.155335288Z [2024-04-03T04:02:00.152+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:02:00.155349101Z [2024-04-03T04:02:00.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:02:00.155353161Z 2024-04-03T04:02:00.155357187Z 2024-04-03T04:02:00.155360862Z 2024-04-03T04:02:00.157660578Z [2024-04-03T04:02:00.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:02:00.157674943Z [2024-04-03T04:02:00.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:02:00.157681845Z [2024-04-03T04:02:00.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:02:00.157686285Z [2024-04-03T04:02:00.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:02:00.157690667Z [2024-04-03T04:02:00.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:02:00.157695084Z [2024-04-03T04:02:00.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:02:00.475755263Z [2024-04-03T04:02:00.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status queued for try_number 1 2024-04-03T04:02:00.476853098Z [2024-04-03T04:02:00.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:01:00+00:00 exited with status queued for try_number 1 2024-04-03T04:02:00.477013725Z [2024-04-03T04:02:00.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:01:00+00:00 exited with status queued for try_number 1 2024-04-03T04:02:00.492102736Z [2024-04-03T04:02:00.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57269130-310e-4926-91e5-310085027e33 2024-04-03T04:02:00.492269355Z [2024-04-03T04:02:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 434e83f9-a32d-43eb-92ef-e9dd34517aa2 2024-04-03T04:02:00.492455751Z [2024-04-03T04:02:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bfa4759-df9c-4814-a4a1-a31a2193a627 2024-04-03T04:02:01.957827132Z [2024-04-03T04:02:01.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:02:01.958958376Z [2024-04-03T04:02:01.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:00:00+00:00, run_id=scheduled__2024-04-03T04:00:00+00:00, run_start_date=2024-04-03 04:02:00.105145+00:00, run_end_date=2024-04-03 04:02:01.957780+00:00, run_duration=1.852635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:00:00+00:00, data_interval_end=2024-04-03 04:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:02:01.967675169Z [2024-04-03T04:02:01.967+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:02:00+00:00, run_after=2024-04-03T04:04:00+00:00 2024-04-03T04:02:02.032506286Z [2024-04-03T04:02:02.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status success for try_number 1 2024-04-03T04:02:02.037517161Z [2024-04-03T04:02:02.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:00:00+00:00, map_index=-1, run_start_date=2024-04-03 04:02:01.332967+00:00, run_end_date=2024-04-03 04:02:01.795250+00:00, run_duration=0.462283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:02:00.154007+00:00, queued_by_job_id=1, pid=12005 2024-04-03T04:02:05.273843942Z [2024-04-03T04:02:05.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:02:05.274362836Z [2024-04-03T04:02:05.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:01:00+00:00, run_id=scheduled__2024-04-03T04:01:00+00:00, run_start_date=2024-04-03 04:02:00.107807+00:00, run_end_date=2024-04-03 04:02:05.273713+00:00, run_duration=5.165906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:01:00+00:00, data_interval_end=2024-04-03 04:02:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:02:05.284100881Z [2024-04-03T04:02:05.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:02:00+00:00, run_after=2024-04-03T04:03:00+00:00 2024-04-03T04:02:05.290284521Z [2024-04-03T04:02:05.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:02:05.290772275Z [2024-04-03T04:02:05.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:01:00+00:00, run_id=scheduled__2024-04-03T04:01:00+00:00, run_start_date=2024-04-03 04:02:00.106546+00:00, run_end_date=2024-04-03 04:02:05.290184+00:00, run_duration=5.183638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:01:00+00:00, data_interval_end=2024-04-03 04:02:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:02:05.301392551Z [2024-04-03T04:02:05.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:02:00+00:00, run_after=2024-04-03T04:03:00+00:00 2024-04-03T04:02:05.332658146Z [2024-04-03T04:02:05.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:01:00+00:00 exited with status success for try_number 1 2024-04-03T04:02:05.332708191Z [2024-04-03T04:02:05.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:01:00+00:00 exited with status success for try_number 1 2024-04-03T04:02:05.340443288Z [2024-04-03T04:02:05.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:01:00+00:00, map_index=-1, run_start_date=2024-04-03 04:02:02.549715+00:00, run_end_date=2024-04-03 04:02:04.448458+00:00, run_duration=1.898743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:02:00.154007+00:00, queued_by_job_id=1, pid=12035 2024-04-03T04:02:05.340586363Z [2024-04-03T04:02:05.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:01:00+00:00, map_index=-1, run_start_date=2024-04-03 04:02:02.750967+00:00, run_end_date=2024-04-03 04:02:04.602044+00:00, run_duration=1.851077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:02:00.154007+00:00, queued_by_job_id=1, pid=12036 2024-04-03T04:03:00.807458453Z [2024-04-03T04:03:00.806+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:03:00.820206504Z [2024-04-03T04:03:00.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:03:00+00:00, run_after=2024-04-03T04:04:00+00:00 2024-04-03T04:03:00.888149786Z [2024-04-03T04:03:00.887+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:03:00.888174847Z 2024-04-03T04:03:00.888178733Z 2024-04-03T04:03:00.888330469Z [2024-04-03T04:03:00.888+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:03:00.888554289Z [2024-04-03T04:03:00.888+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:03:00.889213647Z [2024-04-03T04:03:00.888+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:03:00.889228791Z 2024-04-03T04:03:00.889232677Z 2024-04-03T04:03:00.892499295Z [2024-04-03T04:03:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:03:00.892861956Z [2024-04-03T04:03:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:03:00.893251560Z [2024-04-03T04:03:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:03:00.893645296Z [2024-04-03T04:03:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:03:01.112349123Z [2024-04-03T04:03:01.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:02:00+00:00 exited with status queued for try_number 1 2024-04-03T04:03:01.115170049Z [2024-04-03T04:03:01.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:02:00+00:00 exited with status queued for try_number 1 2024-04-03T04:03:01.127159068Z [2024-04-03T04:03:01.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to baf4b547-f1a9-4180-8fa2-96f45f4dfa9b 2024-04-03T04:03:01.127345331Z [2024-04-03T04:03:01.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1752aec8-5416-48a3-b9b1-59d674efa9c5 2024-04-03T04:03:06.782333046Z [2024-04-03T04:03:06.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:03:06.784114394Z [2024-04-03T04:03:06.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:02:00+00:00, run_id=scheduled__2024-04-03T04:02:00+00:00, run_start_date=2024-04-03 04:03:00.846062+00:00, run_end_date=2024-04-03 04:03:06.782093+00:00, run_duration=5.936031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:02:00+00:00, data_interval_end=2024-04-03 04:03:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:03:06.797386548Z [2024-04-03T04:03:06.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:03:00+00:00, run_after=2024-04-03T04:04:00+00:00 2024-04-03T04:03:06.807241843Z [2024-04-03T04:03:06.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:03:06.810894783Z [2024-04-03T04:03:06.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:02:00+00:00, run_id=scheduled__2024-04-03T04:02:00+00:00, run_start_date=2024-04-03 04:03:00.843618+00:00, run_end_date=2024-04-03 04:03:06.807485+00:00, run_duration=5.963867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:02:00+00:00, data_interval_end=2024-04-03 04:03:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:03:06.824818138Z [2024-04-03T04:03:06.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:03:00+00:00, run_after=2024-04-03T04:04:00+00:00 2024-04-03T04:03:06.875918614Z [2024-04-03T04:03:06.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:02:00+00:00 exited with status success for try_number 1 2024-04-03T04:03:06.876305791Z [2024-04-03T04:03:06.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:02:00+00:00 exited with status success for try_number 1 2024-04-03T04:03:06.888072451Z [2024-04-03T04:03:06.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:02:00+00:00, map_index=-1, run_start_date=2024-04-03 04:03:03.248319+00:00, run_end_date=2024-04-03 04:03:05.670263+00:00, run_duration=2.421944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:03:00.889859+00:00, queued_by_job_id=1, pid=12092 2024-04-03T04:03:06.888392687Z [2024-04-03T04:03:06.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:02:00+00:00, map_index=-1, run_start_date=2024-04-03 04:03:03.193829+00:00, run_end_date=2024-04-03 04:03:06.401615+00:00, run_duration=3.207786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:03:00.889859+00:00, queued_by_job_id=1, pid=12091 2024-04-03T04:04:00.757770654Z [2024-04-03T04:04:00.757+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:04:00.776039747Z [2024-04-03T04:04:00.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:04:00+00:00, run_after=2024-04-03T04:05:00+00:00 2024-04-03T04:04:00.794471884Z [2024-04-03T04:04:00.794+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:04:00.899146549Z [2024-04-03T04:04:00.898+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:04:00.899176341Z 2024-04-03T04:04:00.899181249Z 2024-04-03T04:04:00.899185201Z 2024-04-03T04:04:00.899252190Z [2024-04-03T04:04:00.899+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:04:00.899257471Z [2024-04-03T04:04:00.899+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:04:00.899356897Z [2024-04-03T04:04:00.899+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:04:00.899883566Z [2024-04-03T04:04:00.899+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:04:00.899892971Z 2024-04-03T04:04:00.899897379Z 2024-04-03T04:04:00.899901334Z 2024-04-03T04:04:00.906232098Z [2024-04-03T04:04:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:04:00.906302103Z [2024-04-03T04:04:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:04:00.907475372Z [2024-04-03T04:04:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:04:00.907627766Z [2024-04-03T04:04:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:04:00.907863310Z [2024-04-03T04:04:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:04:00.907965354Z [2024-04-03T04:04:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:04:01.314077081Z [2024-04-03T04:04:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:02:00+00:00 exited with status queued for try_number 1 2024-04-03T04:04:01.319092909Z [2024-04-03T04:04:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:03:00+00:00 exited with status queued for try_number 1 2024-04-03T04:04:01.319335278Z [2024-04-03T04:04:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:03:00+00:00 exited with status queued for try_number 1 2024-04-03T04:04:01.327853122Z [2024-04-03T04:04:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d92027c-56b8-42d3-9a45-1c06fece7ccb 2024-04-03T04:04:01.331050354Z [2024-04-03T04:04:01.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88845337-457b-4ca0-8d1d-b7163c2a5f77 2024-04-03T04:04:01.331319249Z [2024-04-03T04:04:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a2b2827-a899-4687-a858-69860db0f0ef 2024-04-03T04:04:02.565823415Z [2024-04-03T04:04:02.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:04:02.566180922Z [2024-04-03T04:04:02.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:02:00+00:00, run_id=scheduled__2024-04-03T04:02:00+00:00, run_start_date=2024-04-03 04:04:00.805407+00:00, run_end_date=2024-04-03 04:04:02.565738+00:00, run_duration=1.760331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:02:00+00:00, data_interval_end=2024-04-03 04:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:04:02.573620188Z [2024-04-03T04:04:02.573+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:04:00+00:00, run_after=2024-04-03T04:06:00+00:00 2024-04-03T04:04:02.619461336Z [2024-04-03T04:04:02.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:02:00+00:00 exited with status success for try_number 1 2024-04-03T04:04:02.625003016Z [2024-04-03T04:04:02.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:02:00+00:00, map_index=-1, run_start_date=2024-04-03 04:04:01.951112+00:00, run_end_date=2024-04-03 04:04:02.420534+00:00, run_duration=0.469422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:04:00.902726+00:00, queued_by_job_id=1, pid=12127 2024-04-03T04:04:04.920167649Z [2024-04-03T04:04:04.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:04:04.920723516Z [2024-04-03T04:04:04.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:03:00+00:00, run_id=scheduled__2024-04-03T04:03:00+00:00, run_start_date=2024-04-03 04:04:00.806626+00:00, run_end_date=2024-04-03 04:04:04.919956+00:00, run_duration=4.11333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:03:00+00:00, data_interval_end=2024-04-03 04:04:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:04:04.932405908Z [2024-04-03T04:04:04.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:04:00+00:00, run_after=2024-04-03T04:05:00+00:00 2024-04-03T04:04:06.019694897Z [2024-04-03T04:04:06.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:04:06.019983061Z [2024-04-03T04:04:06.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:03:00+00:00, run_id=scheduled__2024-04-03T04:03:00+00:00, run_start_date=2024-04-03 04:04:00.807638+00:00, run_end_date=2024-04-03 04:04:06.019584+00:00, run_duration=5.211946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:03:00+00:00, data_interval_end=2024-04-03 04:04:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:04:06.031292524Z [2024-04-03T04:04:06.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:04:00+00:00, run_after=2024-04-03T04:05:00+00:00 2024-04-03T04:04:06.065354987Z [2024-04-03T04:04:06.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:03:00+00:00 exited with status success for try_number 1 2024-04-03T04:04:06.065464666Z [2024-04-03T04:04:06.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:03:00+00:00 exited with status success for try_number 1 2024-04-03T04:04:06.071642511Z [2024-04-03T04:04:06.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:03:00+00:00, map_index=-1, run_start_date=2024-04-03 04:04:03.518059+00:00, run_end_date=2024-04-03 04:04:04.859011+00:00, run_duration=1.340952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:04:00.902726+00:00, queued_by_job_id=1, pid=12156 2024-04-03T04:04:06.071857139Z [2024-04-03T04:04:06.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:03:00+00:00, map_index=-1, run_start_date=2024-04-03 04:04:03.763154+00:00, run_end_date=2024-04-03 04:04:05.558046+00:00, run_duration=1.794892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:04:00.902726+00:00, queued_by_job_id=1, pid=12158 2024-04-03T04:05:00.573710064Z [2024-04-03T04:05:00.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:05:00+00:00, run_after=2024-04-03T04:10:00+00:00 2024-04-03T04:05:00.583092989Z [2024-04-03T04:05:00.582+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:05:00.597641428Z [2024-04-03T04:05:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:05:00+00:00, run_after=2024-04-03T04:06:00+00:00 2024-04-03T04:05:00.674085666Z [2024-04-03T04:05:00.673+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:05:00.674112329Z 2024-04-03T04:05:00.674116924Z 2024-04-03T04:05:00.674120357Z 2024-04-03T04:05:00.674213136Z [2024-04-03T04:05:00.673+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:05:00.674396406Z [2024-04-03T04:05:00.674+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:05:00.674638355Z [2024-04-03T04:05:00.674+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:05:00.675270609Z [2024-04-03T04:05:00.675+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:05:00.675282626Z 2024-04-03T04:05:00.675287440Z 2024-04-03T04:05:00.675291672Z 2024-04-03T04:05:00.679097478Z [2024-04-03T04:05:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T04:05:00.679289387Z [2024-04-03T04:05:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:05:00.679612792Z [2024-04-03T04:05:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:05:00.679740516Z [2024-04-03T04:05:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:05:00.680055747Z [2024-04-03T04:05:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:05:00.680220043Z [2024-04-03T04:05:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:05:01.100935069Z [2024-04-03T04:05:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status queued for try_number 1 2024-04-03T04:05:01.101158887Z [2024-04-03T04:05:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:04:00+00:00 exited with status queued for try_number 1 2024-04-03T04:05:01.101369007Z [2024-04-03T04:05:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:04:00+00:00 exited with status queued for try_number 1 2024-04-03T04:05:01.110939177Z [2024-04-03T04:05:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01876efe-5fea-4a77-aa1a-133b1cb7336b 2024-04-03T04:05:01.111286840Z [2024-04-03T04:05:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5bc75e6-fc6c-48cf-9830-c698e4613582 2024-04-03T04:05:01.111452325Z [2024-04-03T04:05:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d1c7717-6c0b-49a3-ac3c-e181fcc75d91 2024-04-03T04:05:04.668708070Z [2024-04-03T04:05:04.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:05:04.669253101Z [2024-04-03T04:05:04.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:04:00+00:00, run_id=scheduled__2024-04-03T04:04:00+00:00, run_start_date=2024-04-03 04:05:00.610804+00:00, run_end_date=2024-04-03 04:05:04.668851+00:00, run_duration=4.058047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:04:00+00:00, data_interval_end=2024-04-03 04:05:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:05:04.679587085Z [2024-04-03T04:05:04.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:05:00+00:00, run_after=2024-04-03T04:06:00+00:00 2024-04-03T04:05:04.697200582Z [2024-04-03T04:05:04.696+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:05:04.697220353Z 2024-04-03T04:05:04.697505576Z [2024-04-03T04:05:04.697+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:05:04.698162213Z [2024-04-03T04:05:04.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:05:04.698173759Z 2024-04-03T04:05:04.700654651Z [2024-04-03T04:05:04.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T04:05:04.700921005Z [2024-04-03T04:05:04.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:05:04.748619183Z [2024-04-03T04:05:04.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status queued for try_number 1 2024-04-03T04:05:04.748988318Z [2024-04-03T04:05:04.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status success for try_number 1 2024-04-03T04:05:04.749252449Z [2024-04-03T04:05:04.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:04:00+00:00 exited with status success for try_number 1 2024-04-03T04:05:04.757143811Z [2024-04-03T04:05:04.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6a25b8d-d307-4926-bdcb-9c88e29614c2 2024-04-03T04:05:04.757665420Z [2024-04-03T04:05:04.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T04:00:00+00:00, map_index=-1, run_start_date=2024-04-03 04:05:03.138791+00:00, run_end_date=2024-04-03 04:05:03.709033+00:00, run_duration=0.570242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:05:00.676139+00:00, queued_by_job_id=1, pid=12224 2024-04-03T04:05:04.758198223Z [2024-04-03T04:05:04.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:04:00+00:00, map_index=-1, run_start_date=2024-04-03 04:05:02.971812+00:00, run_end_date=2024-04-03 04:05:04.482862+00:00, run_duration=1.51105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:05:00.676139+00:00, queued_by_job_id=1, pid=12223 2024-04-03T04:05:05.906454479Z [2024-04-03T04:05:05.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:05:05.907000259Z [2024-04-03T04:05:05.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:04:00+00:00, run_id=scheduled__2024-04-03T04:04:00+00:00, run_start_date=2024-04-03 04:05:00.611853+00:00, run_end_date=2024-04-03 04:05:05.906316+00:00, run_duration=5.294463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:04:00+00:00, data_interval_end=2024-04-03 04:05:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:05:05.917752034Z [2024-04-03T04:05:05.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:05:00+00:00, run_after=2024-04-03T04:06:00+00:00 2024-04-03T04:05:05.964817617Z [2024-04-03T04:05:05.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:04:00+00:00 exited with status success for try_number 1 2024-04-03T04:05:05.971195133Z [2024-04-03T04:05:05.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:04:00+00:00, map_index=-1, run_start_date=2024-04-03 04:05:03.266505+00:00, run_end_date=2024-04-03 04:05:05.068402+00:00, run_duration=1.801897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:05:00.676139+00:00, queued_by_job_id=1, pid=12225 2024-04-03T04:05:07.036122928Z [2024-04-03T04:05:07.035+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:05:07.036154492Z 2024-04-03T04:05:07.036171104Z [2024-04-03T04:05:07.036+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:05:07.036808945Z [2024-04-03T04:05:07.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:05:07.036823064Z 2024-04-03T04:05:07.038922349Z [2024-04-03T04:05:07.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T04:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T04:05:07.039074154Z [2024-04-03T04:05:07.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:05:07.089675747Z [2024-04-03T04:05:07.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status queued for try_number 1 2024-04-03T04:05:07.089884970Z [2024-04-03T04:05:07.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status success for try_number 1 2024-04-03T04:05:07.100011964Z [2024-04-03T04:05:07.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to fad6cc80-6fe5-48b5-95f3-8c8937c23593 2024-04-03T04:05:07.100232943Z [2024-04-03T04:05:07.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T04:00:00+00:00, map_index=-1, run_start_date=2024-04-03 04:05:06.439146+00:00, run_end_date=2024-04-03 04:05:06.798843+00:00, run_duration=0.359697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:05:04.698564+00:00, queued_by_job_id=1, pid=12264 2024-04-03T04:05:09.839367582Z [2024-04-03T04:05:09.838+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:05:09.839423491Z 2024-04-03T04:05:09.854708495Z [2024-04-03T04:05:09.854+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:05:09.857757103Z [2024-04-03T04:05:09.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:05:09.857778376Z 2024-04-03T04:05:09.872058692Z [2024-04-03T04:05:09.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:05:09.872091740Z [2024-04-03T04:05:09.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:05:09.966295632Z [2024-04-03T04:05:09.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status queued for try_number 1 2024-04-03T04:05:09.966578113Z [2024-04-03T04:05:09.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status success for try_number 1 2024-04-03T04:05:09.972506493Z [2024-04-03T04:05:09.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0277d3c-ed9a-4d67-b469-a1dd4b8642ed 2024-04-03T04:05:09.972955451Z [2024-04-03T04:05:09.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T04:00:00+00:00, map_index=0, run_start_date=2024-04-03 04:05:08.618259+00:00, run_end_date=2024-04-03 04:05:09.006471+00:00, run_duration=0.388212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:05:07.037124+00:00, queued_by_job_id=1, pid=12276 2024-04-03T04:05:12.207784414Z [2024-04-03T04:05:12.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:05:12.208140009Z [2024-04-03T04:05:12.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:00:00+00:00, run_id=scheduled__2024-04-03T04:00:00+00:00, run_start_date=2024-04-03 04:05:00.609464+00:00, run_end_date=2024-04-03 04:05:12.207834+00:00, run_duration=11.59837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:00:00+00:00, data_interval_end=2024-04-03 04:05:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T04:05:12.215146789Z [2024-04-03T04:05:12.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:05:00+00:00, run_after=2024-04-03T04:10:00+00:00 2024-04-03T04:05:13.315135485Z [2024-04-03T04:05:13.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T04:00:00+00:00 exited with status success for try_number 1 2024-04-03T04:05:13.331767140Z [2024-04-03T04:05:13.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T04:00:00+00:00, map_index=-1, run_start_date=2024-04-03 04:05:11.759172+00:00, run_end_date=2024-04-03 04:05:12.127952+00:00, run_duration=0.36878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:05:09.859347+00:00, queued_by_job_id=1, pid=12288 2024-04-03T04:06:00.487585146Z [2024-04-03T04:06:00.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:06:00+00:00, run_after=2024-04-03T04:07:00+00:00 2024-04-03T04:06:00.495056372Z [2024-04-03T04:06:00.494+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:06:00.501721945Z [2024-04-03T04:06:00.501+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:06:00.559018230Z [2024-04-03T04:06:00.558+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:06:00.559050254Z 2024-04-03T04:06:00.559054469Z 2024-04-03T04:06:00.559058003Z 2024-04-03T04:06:00.559176100Z [2024-04-03T04:06:00.558+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:06:00.559362310Z [2024-04-03T04:06:00.559+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:06:00.559494106Z [2024-04-03T04:06:00.559+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:06:00.560358081Z [2024-04-03T04:06:00.560+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:06:00.560369943Z 2024-04-03T04:06:00.560373936Z 2024-04-03T04:06:00.560377308Z 2024-04-03T04:06:00.563708853Z [2024-04-03T04:06:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:06:00.563927630Z [2024-04-03T04:06:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:06:00.564309764Z [2024-04-03T04:06:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:06:00.564499010Z [2024-04-03T04:06:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:06:00.564858861Z [2024-04-03T04:06:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:06:00.565070875Z [2024-04-03T04:06:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:06:00.962401589Z [2024-04-03T04:06:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:04:00+00:00 exited with status queued for try_number 1 2024-04-03T04:06:00.962562957Z [2024-04-03T04:06:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status queued for try_number 1 2024-04-03T04:06:00.962704741Z [2024-04-03T04:06:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status queued for try_number 1 2024-04-03T04:06:00.969733861Z [2024-04-03T04:06:00.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to f493c441-00c6-4af6-a972-3ce10082cab4 2024-04-03T04:06:00.969962356Z [2024-04-03T04:06:00.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to a13cf676-7147-4df9-970b-c20650a396f8 2024-04-03T04:06:00.970123149Z [2024-04-03T04:06:00.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14b6dda1-732e-4dff-a9e2-e1eec52e668a 2024-04-03T04:06:02.143416328Z [2024-04-03T04:06:02.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:06:02.143893908Z [2024-04-03T04:06:02.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:04:00+00:00, run_id=scheduled__2024-04-03T04:04:00+00:00, run_start_date=2024-04-03 04:06:00.511478+00:00, run_end_date=2024-04-03 04:06:02.143533+00:00, run_duration=1.632055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:04:00+00:00, data_interval_end=2024-04-03 04:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:06:02.152122227Z [2024-04-03T04:06:02.151+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:06:00+00:00, run_after=2024-04-03T04:08:00+00:00 2024-04-03T04:06:02.201238291Z [2024-04-03T04:06:02.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:04:00+00:00 exited with status success for try_number 1 2024-04-03T04:06:02.206490727Z [2024-04-03T04:06:02.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:04:00+00:00, map_index=-1, run_start_date=2024-04-03 04:06:01.523423+00:00, run_end_date=2024-04-03 04:06:01.873884+00:00, run_duration=0.350461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:06:00.561006+00:00, queued_by_job_id=1, pid=12305 2024-04-03T04:06:05.596506069Z [2024-04-03T04:06:05.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:06:05.597113296Z [2024-04-03T04:06:05.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:05:00+00:00, run_id=scheduled__2024-04-03T04:05:00+00:00, run_start_date=2024-04-03 04:06:00.513902+00:00, run_end_date=2024-04-03 04:06:05.596299+00:00, run_duration=5.082397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:05:00+00:00, data_interval_end=2024-04-03 04:06:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:06:05.618688697Z [2024-04-03T04:06:05.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:06:00+00:00, run_after=2024-04-03T04:07:00+00:00 2024-04-03T04:06:05.627880256Z [2024-04-03T04:06:05.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:06:05.628345153Z [2024-04-03T04:06:05.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:05:00+00:00, run_id=scheduled__2024-04-03T04:05:00+00:00, run_start_date=2024-04-03 04:06:00.512799+00:00, run_end_date=2024-04-03 04:06:05.627970+00:00, run_duration=5.115171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:05:00+00:00, data_interval_end=2024-04-03 04:06:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:06:05.639095507Z [2024-04-03T04:06:05.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:06:00+00:00, run_after=2024-04-03T04:07:00+00:00 2024-04-03T04:06:05.670308127Z [2024-04-03T04:06:05.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status success for try_number 1 2024-04-03T04:06:05.670362894Z [2024-04-03T04:06:05.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status success for try_number 1 2024-04-03T04:06:05.676855007Z [2024-04-03T04:06:05.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:05:00+00:00, map_index=-1, run_start_date=2024-04-03 04:06:03.018922+00:00, run_end_date=2024-04-03 04:06:04.864605+00:00, run_duration=1.845683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:06:00.561006+00:00, queued_by_job_id=1, pid=12345 2024-04-03T04:06:05.677074167Z [2024-04-03T04:06:05.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:05:00+00:00, map_index=-1, run_start_date=2024-04-03 04:06:02.629836+00:00, run_end_date=2024-04-03 04:06:05.251626+00:00, run_duration=2.62179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:06:00.561006+00:00, queued_by_job_id=1, pid=12326 2024-04-03T04:06:36.587841899Z [2024-04-03T04:06:36.586+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T04:07:00.222279401Z [2024-04-03T04:07:00.221+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:07:00.234648976Z [2024-04-03T04:07:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:07:00+00:00, run_after=2024-04-03T04:08:00+00:00 2024-04-03T04:07:00.286900905Z [2024-04-03T04:07:00.286+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:07:00.286933346Z 2024-04-03T04:07:00.286937097Z 2024-04-03T04:07:00.287071532Z [2024-04-03T04:07:00.286+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:07:00.287236590Z [2024-04-03T04:07:00.287+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:07:00.287817957Z [2024-04-03T04:07:00.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:07:00.287826259Z 2024-04-03T04:07:00.287829590Z 2024-04-03T04:07:00.290748680Z [2024-04-03T04:07:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:07:00.290917118Z [2024-04-03T04:07:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:07:00.291137013Z [2024-04-03T04:07:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:07:00.291278938Z [2024-04-03T04:07:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:07:00.449253446Z [2024-04-03T04:07:00.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:06:00+00:00 exited with status queued for try_number 1 2024-04-03T04:07:00.451109568Z [2024-04-03T04:07:00.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:06:00+00:00 exited with status queued for try_number 1 2024-04-03T04:07:00.463761155Z [2024-04-03T04:07:00.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bb7f9e7-6cde-4c54-8ade-aa41a6a6724c 2024-04-03T04:07:00.463912053Z [2024-04-03T04:07:00.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to e74e1de4-963d-494d-8bb5-ddb1b4079790 2024-04-03T04:07:05.177054095Z [2024-04-03T04:07:05.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:07:05.177884552Z [2024-04-03T04:07:05.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:06:00+00:00, run_id=scheduled__2024-04-03T04:06:00+00:00, run_start_date=2024-04-03 04:07:00.247020+00:00, run_end_date=2024-04-03 04:07:05.177448+00:00, run_duration=4.930428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:06:00+00:00, data_interval_end=2024-04-03 04:07:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:07:05.193045610Z [2024-04-03T04:07:05.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:07:00+00:00, run_after=2024-04-03T04:08:00+00:00 2024-04-03T04:07:05.200775395Z [2024-04-03T04:07:05.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:07:05.201262074Z [2024-04-03T04:07:05.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:06:00+00:00, run_id=scheduled__2024-04-03T04:06:00+00:00, run_start_date=2024-04-03 04:07:00.245372+00:00, run_end_date=2024-04-03 04:07:05.200920+00:00, run_duration=4.955548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:06:00+00:00, data_interval_end=2024-04-03 04:07:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:07:05.212017966Z [2024-04-03T04:07:05.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:07:00+00:00, run_after=2024-04-03T04:08:00+00:00 2024-04-03T04:07:05.269972353Z [2024-04-03T04:07:05.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:06:00+00:00 exited with status success for try_number 1 2024-04-03T04:07:05.279179726Z [2024-04-03T04:07:05.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:06:00+00:00, map_index=-1, run_start_date=2024-04-03 04:07:02.562385+00:00, run_end_date=2024-04-03 04:07:04.358763+00:00, run_duration=1.796378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:07:00.288424+00:00, queued_by_job_id=1, pid=12381 2024-04-03T04:07:05.580563663Z [2024-04-03T04:07:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:06:00+00:00 exited with status success for try_number 1 2024-04-03T04:07:05.590285758Z [2024-04-03T04:07:05.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:06:00+00:00, map_index=-1, run_start_date=2024-04-03 04:07:02.944756+00:00, run_end_date=2024-04-03 04:07:05.126139+00:00, run_duration=2.181383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:07:00.288424+00:00, queued_by_job_id=1, pid=12400 2024-04-03T04:08:00.399289696Z [2024-04-03T04:08:00.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:08:00+00:00, run_after=2024-04-03T04:09:00+00:00 2024-04-03T04:08:00.406630901Z [2024-04-03T04:08:00.406+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:08:00.412837435Z [2024-04-03T04:08:00.412+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:08:00.476419652Z [2024-04-03T04:08:00.476+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:08:00.476445297Z 2024-04-03T04:08:00.476449719Z 2024-04-03T04:08:00.476453037Z 2024-04-03T04:08:00.476680408Z [2024-04-03T04:08:00.476+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:08:00.476897089Z [2024-04-03T04:08:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:08:00.477069541Z [2024-04-03T04:08:00.476+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:08:00.477699252Z [2024-04-03T04:08:00.477+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:08:00.477713129Z 2024-04-03T04:08:00.477717200Z 2024-04-03T04:08:00.477720513Z 2024-04-03T04:08:00.480948256Z [2024-04-03T04:08:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:08:00.481265015Z [2024-04-03T04:08:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:08:00.481612838Z [2024-04-03T04:08:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:08:00.482683128Z [2024-04-03T04:08:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:08:00.483076817Z [2024-04-03T04:08:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:08:00.483243350Z [2024-04-03T04:08:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:08:00.908454206Z [2024-04-03T04:08:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:06:00+00:00 exited with status queued for try_number 1 2024-04-03T04:08:00.910659237Z [2024-04-03T04:08:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:07:00+00:00 exited with status queued for try_number 1 2024-04-03T04:08:00.910711825Z [2024-04-03T04:08:00.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:07:00+00:00 exited with status queued for try_number 1 2024-04-03T04:08:00.922505087Z [2024-04-03T04:08:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to a05d866e-5032-4c30-8370-95f50218d493 2024-04-03T04:08:00.922653124Z [2024-04-03T04:08:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to f64b8c24-07ec-43ce-a73d-acaaa5897bfe 2024-04-03T04:08:00.922773948Z [2024-04-03T04:08:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 748622ba-0685-4fa1-a482-ee118efea5c9 2024-04-03T04:08:02.458952746Z [2024-04-03T04:08:02.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:08:02.459427508Z [2024-04-03T04:08:02.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:06:00+00:00, run_id=scheduled__2024-04-03T04:06:00+00:00, run_start_date=2024-04-03 04:08:00.422700+00:00, run_end_date=2024-04-03 04:08:02.458873+00:00, run_duration=2.036173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:06:00+00:00, data_interval_end=2024-04-03 04:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:08:02.466691202Z [2024-04-03T04:08:02.466+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:08:00+00:00, run_after=2024-04-03T04:10:00+00:00 2024-04-03T04:08:02.522417536Z [2024-04-03T04:08:02.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:06:00+00:00 exited with status success for try_number 1 2024-04-03T04:08:02.528520644Z [2024-04-03T04:08:02.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:06:00+00:00, map_index=-1, run_start_date=2024-04-03 04:08:01.412124+00:00, run_end_date=2024-04-03 04:08:01.849896+00:00, run_duration=0.437772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:08:00.478405+00:00, queued_by_job_id=1, pid=12425 2024-04-03T04:08:04.479544939Z [2024-04-03T04:08:04.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:08:04.479649478Z [2024-04-03T04:08:04.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:07:00+00:00, run_id=scheduled__2024-04-03T04:07:00+00:00, run_start_date=2024-04-03 04:08:00.423862+00:00, run_end_date=2024-04-03 04:08:04.479356+00:00, run_duration=4.055494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:07:00+00:00, data_interval_end=2024-04-03 04:08:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:08:04.494932301Z [2024-04-03T04:08:04.494+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:08:00+00:00, run_after=2024-04-03T04:09:00+00:00 2024-04-03T04:08:05.642707085Z [2024-04-03T04:08:05.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:07:00+00:00 exited with status success for try_number 1 2024-04-03T04:08:05.649678571Z [2024-04-03T04:08:05.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:07:00+00:00, map_index=-1, run_start_date=2024-04-03 04:08:02.784511+00:00, run_end_date=2024-04-03 04:08:04.421598+00:00, run_duration=1.637087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:08:00.478405+00:00, queued_by_job_id=1, pid=12449 2024-04-03T04:08:06.464842878Z [2024-04-03T04:08:06.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:08:06.464986928Z [2024-04-03T04:08:06.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:07:00+00:00, run_id=scheduled__2024-04-03T04:07:00+00:00, run_start_date=2024-04-03 04:08:00.424926+00:00, run_end_date=2024-04-03 04:08:06.464717+00:00, run_duration=6.039791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:07:00+00:00, data_interval_end=2024-04-03 04:08:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:08:06.473997373Z [2024-04-03T04:08:06.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:08:00+00:00, run_after=2024-04-03T04:09:00+00:00 2024-04-03T04:08:06.499613529Z [2024-04-03T04:08:06.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:07:00+00:00 exited with status success for try_number 1 2024-04-03T04:08:06.504478209Z [2024-04-03T04:08:06.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:07:00+00:00, map_index=-1, run_start_date=2024-04-03 04:08:03.015936+00:00, run_end_date=2024-04-03 04:08:05.945647+00:00, run_duration=2.929711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:08:00.478405+00:00, queued_by_job_id=1, pid=12456 2024-04-03T04:09:00.377078472Z [2024-04-03T04:09:00.376+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:09:00.390339725Z [2024-04-03T04:09:00.389+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:09:00+00:00, run_after=2024-04-03T04:10:00+00:00 2024-04-03T04:09:00.448417637Z [2024-04-03T04:09:00.448+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:09:00.448451385Z 2024-04-03T04:09:00.448456326Z 2024-04-03T04:09:00.448666344Z [2024-04-03T04:09:00.448+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:09:00.448934633Z [2024-04-03T04:09:00.448+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:09:00.449559894Z [2024-04-03T04:09:00.449+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:09:00.449578274Z 2024-04-03T04:09:00.449581986Z 2024-04-03T04:09:00.452363993Z [2024-04-03T04:09:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:09:00.452680786Z [2024-04-03T04:09:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:09:00.452997320Z [2024-04-03T04:09:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:09:00.453096440Z [2024-04-03T04:09:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:09:00.676083281Z [2024-04-03T04:09:00.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:08:00+00:00 exited with status queued for try_number 1 2024-04-03T04:09:00.676156888Z [2024-04-03T04:09:00.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:08:00+00:00 exited with status queued for try_number 1 2024-04-03T04:09:00.683054824Z [2024-04-03T04:09:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24b5d55b-74e5-4d29-8f0d-03f6d5354049 2024-04-03T04:09:00.683079512Z [2024-04-03T04:09:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to e80bf076-8ba0-40de-990b-1953ed90e2d9 2024-04-03T04:09:04.101386217Z [2024-04-03T04:09:04.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:09:04.102068773Z [2024-04-03T04:09:04.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:08:00+00:00, run_id=scheduled__2024-04-03T04:08:00+00:00, run_start_date=2024-04-03 04:09:00.401241+00:00, run_end_date=2024-04-03 04:09:04.101560+00:00, run_duration=3.700319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:08:00+00:00, data_interval_end=2024-04-03 04:09:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:09:04.110576763Z [2024-04-03T04:09:04.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:09:00+00:00, run_after=2024-04-03T04:10:00+00:00 2024-04-03T04:09:04.160797299Z [2024-04-03T04:09:04.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:08:00+00:00 exited with status success for try_number 1 2024-04-03T04:09:04.168549202Z [2024-04-03T04:09:04.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:08:00+00:00, map_index=-1, run_start_date=2024-04-03 04:09:02.574904+00:00, run_end_date=2024-04-03 04:09:03.889791+00:00, run_duration=1.314887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:09:00.450113+00:00, queued_by_job_id=1, pid=12511 2024-04-03T04:09:04.900708197Z [2024-04-03T04:09:04.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:09:04.901216206Z [2024-04-03T04:09:04.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:08:00+00:00, run_id=scheduled__2024-04-03T04:08:00+00:00, run_start_date=2024-04-03 04:09:00.402445+00:00, run_end_date=2024-04-03 04:09:04.900827+00:00, run_duration=4.498382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:08:00+00:00, data_interval_end=2024-04-03 04:09:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:09:04.913213082Z [2024-04-03T04:09:04.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:09:00+00:00, run_after=2024-04-03T04:10:00+00:00 2024-04-03T04:09:04.974450950Z [2024-04-03T04:09:04.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:08:00+00:00 exited with status success for try_number 1 2024-04-03T04:09:04.985659514Z [2024-04-03T04:09:04.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:08:00+00:00, map_index=-1, run_start_date=2024-04-03 04:09:02.544581+00:00, run_end_date=2024-04-03 04:09:04.308540+00:00, run_duration=1.763959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:09:00.450113+00:00, queued_by_job_id=1, pid=12510 2024-04-03T04:10:00.235405366Z [2024-04-03T04:10:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:10:00+00:00, run_after=2024-04-03T04:15:00+00:00 2024-04-03T04:10:00.245052155Z [2024-04-03T04:10:00.244+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:10:00.255308720Z [2024-04-03T04:10:00.254+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:10:00.273301496Z [2024-04-03T04:10:00.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:10:00+00:00, run_after=2024-04-03T04:11:00+00:00 2024-04-03T04:10:00.346997581Z [2024-04-03T04:10:00.346+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T04:10:00.347024439Z 2024-04-03T04:10:00.347028172Z 2024-04-03T04:10:00.347031993Z 2024-04-03T04:10:00.347035281Z 2024-04-03T04:10:00.347297007Z [2024-04-03T04:10:00.346+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:10:00.347518806Z [2024-04-03T04:10:00.347+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:10:00.347706232Z [2024-04-03T04:10:00.347+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:10:00.347900024Z [2024-04-03T04:10:00.347+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:10:00.348544944Z [2024-04-03T04:10:00.348+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:10:00.348556518Z 2024-04-03T04:10:00.348560508Z 2024-04-03T04:10:00.348563850Z 2024-04-03T04:10:00.348582666Z 2024-04-03T04:10:00.352037745Z [2024-04-03T04:10:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T04:10:00.352303213Z [2024-04-03T04:10:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:10:00.352650107Z [2024-04-03T04:10:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:10:00.352848200Z [2024-04-03T04:10:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:10:00.353145680Z [2024-04-03T04:10:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:10:00.353344918Z [2024-04-03T04:10:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:10:00.353705396Z [2024-04-03T04:10:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:10:00.353909194Z [2024-04-03T04:10:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:10:00.635078227Z [2024-04-03T04:10:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status queued for try_number 1 2024-04-03T04:10:00.635325654Z [2024-04-03T04:10:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:08:00+00:00 exited with status queued for try_number 1 2024-04-03T04:10:00.647532974Z [2024-04-03T04:10:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:09:00+00:00 exited with status queued for try_number 1 2024-04-03T04:10:00.647555104Z [2024-04-03T04:10:00.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:09:00+00:00 exited with status queued for try_number 1 2024-04-03T04:10:00.662424350Z [2024-04-03T04:10:00.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cac31d5-2961-4425-9430-dc51060206b5 2024-04-03T04:10:00.662816176Z [2024-04-03T04:10:00.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cca39fe-0e84-47db-8273-5e0a469a41a9 2024-04-03T04:10:00.664196743Z [2024-04-03T04:10:00.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31032bb3-2485-4536-a969-968a2f6a51f9 2024-04-03T04:10:00.664486213Z [2024-04-03T04:10:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdf7951f-4017-4a2e-8048-8edef9cc7726 2024-04-03T04:10:03.194577734Z [2024-04-03T04:10:03.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:10:03.195760504Z [2024-04-03T04:10:03.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:08:00+00:00, run_id=scheduled__2024-04-03T04:08:00+00:00, run_start_date=2024-04-03 04:10:00.285379+00:00, run_end_date=2024-04-03 04:10:03.194493+00:00, run_duration=2.909114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:08:00+00:00, data_interval_end=2024-04-03 04:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:10:03.223739721Z [2024-04-03T04:10:03.223+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:10:00+00:00, run_after=2024-04-03T04:12:00+00:00 2024-04-03T04:10:03.362103749Z [2024-04-03T04:10:03.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:08:00+00:00 exited with status success for try_number 1 2024-04-03T04:10:03.370455860Z [2024-04-03T04:10:03.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:08:00+00:00, map_index=-1, run_start_date=2024-04-03 04:10:01.663715+00:00, run_end_date=2024-04-03 04:10:02.096774+00:00, run_duration=0.433059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:10:00.349462+00:00, queued_by_job_id=1, pid=12546 2024-04-03T04:10:04.409103036Z [2024-04-03T04:10:04.408+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:10:04.409130620Z 2024-04-03T04:10:04.409395921Z [2024-04-03T04:10:04.409+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:10:04.410476770Z [2024-04-03T04:10:04.410+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:10:04.410487658Z 2024-04-03T04:10:04.414350836Z [2024-04-03T04:10:04.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T04:10:04.414628358Z [2024-04-03T04:10:04.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:10:04.458769885Z [2024-04-03T04:10:04.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status queued for try_number 1 2024-04-03T04:10:04.459069110Z [2024-04-03T04:10:04.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status success for try_number 1 2024-04-03T04:10:04.475525765Z [2024-04-03T04:10:04.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca62e0b5-f196-4d3c-a0f1-5b31e8faa956 2024-04-03T04:10:04.475765842Z [2024-04-03T04:10:04.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T04:05:00+00:00, map_index=-1, run_start_date=2024-04-03 04:10:02.963093+00:00, run_end_date=2024-04-03 04:10:03.515573+00:00, run_duration=0.55248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:10:00.349462+00:00, queued_by_job_id=1, pid=12582 2024-04-03T04:10:05.310802571Z [2024-04-03T04:10:05.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:10:05.310978214Z [2024-04-03T04:10:05.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:09:00+00:00, run_id=scheduled__2024-04-03T04:09:00+00:00, run_start_date=2024-04-03 04:10:00.286413+00:00, run_end_date=2024-04-03 04:10:05.310661+00:00, run_duration=5.024248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:09:00+00:00, data_interval_end=2024-04-03 04:10:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:10:05.320013438Z [2024-04-03T04:10:05.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:10:00+00:00, run_after=2024-04-03T04:11:00+00:00 2024-04-03T04:10:05.327095101Z [2024-04-03T04:10:05.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:10:05.327411343Z [2024-04-03T04:10:05.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:09:00+00:00, run_id=scheduled__2024-04-03T04:09:00+00:00, run_start_date=2024-04-03 04:10:00.287501+00:00, run_end_date=2024-04-03 04:10:05.326999+00:00, run_duration=5.039498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:09:00+00:00, data_interval_end=2024-04-03 04:10:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:10:05.336350257Z [2024-04-03T04:10:05.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:10:00+00:00, run_after=2024-04-03T04:11:00+00:00 2024-04-03T04:10:05.374691503Z [2024-04-03T04:10:05.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:09:00+00:00 exited with status success for try_number 1 2024-04-03T04:10:05.381815046Z [2024-04-03T04:10:05.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:09:00+00:00, map_index=-1, run_start_date=2024-04-03 04:10:03.303300+00:00, run_end_date=2024-04-03 04:10:04.816131+00:00, run_duration=1.512831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:10:00.349462+00:00, queued_by_job_id=1, pid=12588 2024-04-03T04:10:06.444978903Z [2024-04-03T04:10:06.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:09:00+00:00 exited with status success for try_number 1 2024-04-03T04:10:06.449271636Z [2024-04-03T04:10:06.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:09:00+00:00, map_index=-1, run_start_date=2024-04-03 04:10:03.217069+00:00, run_end_date=2024-04-03 04:10:05.225075+00:00, run_duration=2.008006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:10:00.349462+00:00, queued_by_job_id=1, pid=12587 2024-04-03T04:10:07.546956640Z [2024-04-03T04:10:07.546+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:10:07.546989278Z 2024-04-03T04:10:07.547382101Z [2024-04-03T04:10:07.547+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:10:07.548470537Z [2024-04-03T04:10:07.548+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:10:07.548483598Z 2024-04-03T04:10:07.552092383Z [2024-04-03T04:10:07.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T04:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T04:10:07.552492772Z [2024-04-03T04:10:07.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:10:07.614672532Z [2024-04-03T04:10:07.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status queued for try_number 1 2024-04-03T04:10:07.614970435Z [2024-04-03T04:10:07.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status success for try_number 1 2024-04-03T04:10:07.622389028Z [2024-04-03T04:10:07.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to f61d4528-8fc8-4ec8-afd6-1772cecefe8a 2024-04-03T04:10:07.622822238Z [2024-04-03T04:10:07.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T04:05:00+00:00, map_index=-1, run_start_date=2024-04-03 04:10:06.026412+00:00, run_end_date=2024-04-03 04:10:06.349200+00:00, run_duration=0.322788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:10:04.411172+00:00, queued_by_job_id=1, pid=12627 2024-04-03T04:10:10.622804539Z [2024-04-03T04:10:10.622+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:10:10.622837938Z 2024-04-03T04:10:10.623190657Z [2024-04-03T04:10:10.622+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:10:10.623976758Z [2024-04-03T04:10:10.623+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:10:10.623990343Z 2024-04-03T04:10:10.627473744Z [2024-04-03T04:10:10.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:10:10.627835750Z [2024-04-03T04:10:10.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:10:10.690153218Z [2024-04-03T04:10:10.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status queued for try_number 1 2024-04-03T04:10:10.691647182Z [2024-04-03T04:10:10.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status success for try_number 1 2024-04-03T04:10:10.699839737Z [2024-04-03T04:10:10.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to e04bf935-e943-40b4-a85e-ecc7f884d454 2024-04-03T04:10:10.700670274Z [2024-04-03T04:10:10.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T04:05:00+00:00, map_index=0, run_start_date=2024-04-03 04:10:09.181627+00:00, run_end_date=2024-04-03 04:10:09.520126+00:00, run_duration=0.338499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:10:07.549103+00:00, queued_by_job_id=1, pid=12639 2024-04-03T04:10:13.071384662Z [2024-04-03T04:10:13.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:10:13.075137564Z [2024-04-03T04:10:13.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:05:00+00:00, run_id=scheduled__2024-04-03T04:05:00+00:00, run_start_date=2024-04-03 04:10:00.284021+00:00, run_end_date=2024-04-03 04:10:13.074680+00:00, run_duration=12.790659, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:05:00+00:00, data_interval_end=2024-04-03 04:10:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T04:10:13.098095777Z [2024-04-03T04:10:13.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:10:00+00:00, run_after=2024-04-03T04:15:00+00:00 2024-04-03T04:10:13.129253983Z [2024-04-03T04:10:13.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T04:05:00+00:00 exited with status success for try_number 1 2024-04-03T04:10:13.135581770Z [2024-04-03T04:10:13.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T04:05:00+00:00, map_index=-1, run_start_date=2024-04-03 04:10:12.418684+00:00, run_end_date=2024-04-03 04:10:12.741426+00:00, run_duration=0.322742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:10:10.624708+00:00, queued_by_job_id=1, pid=12651 2024-04-03T04:11:00.136670553Z [2024-04-03T04:11:00.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:11:00+00:00, run_after=2024-04-03T04:12:00+00:00 2024-04-03T04:11:00.144434456Z [2024-04-03T04:11:00.144+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:11:00.217564583Z [2024-04-03T04:11:00.217+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:11:00.217587312Z 2024-04-03T04:11:00.217590908Z 2024-04-03T04:11:00.217657014Z [2024-04-03T04:11:00.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:11:00.217760964Z [2024-04-03T04:11:00.217+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:11:00.218209023Z [2024-04-03T04:11:00.218+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:11:00.218220049Z 2024-04-03T04:11:00.218223733Z 2024-04-03T04:11:00.225077916Z [2024-04-03T04:11:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:11:00.225224455Z [2024-04-03T04:11:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:11:00.225485472Z [2024-04-03T04:11:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:11:00.225617891Z [2024-04-03T04:11:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:11:00.476107950Z [2024-04-03T04:11:00.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status queued for try_number 1 2024-04-03T04:11:00.476281160Z [2024-04-03T04:11:00.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status queued for try_number 1 2024-04-03T04:11:00.488264141Z [2024-04-03T04:11:00.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4162d65d-b6ba-417f-97f1-134aee321b5e 2024-04-03T04:11:00.488700457Z [2024-04-03T04:11:00.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2100dabe-be9a-4774-8654-83cf93efb7e9 2024-04-03T04:11:04.144531525Z [2024-04-03T04:11:04.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:11:04.145044175Z [2024-04-03T04:11:04.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:10:00+00:00, run_id=scheduled__2024-04-03T04:10:00+00:00, run_start_date=2024-04-03 04:11:00.173263+00:00, run_end_date=2024-04-03 04:11:04.144677+00:00, run_duration=3.971414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:10:00+00:00, data_interval_end=2024-04-03 04:11:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:11:04.154203024Z [2024-04-03T04:11:04.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:11:00+00:00, run_after=2024-04-03T04:12:00+00:00 2024-04-03T04:11:04.162492306Z [2024-04-03T04:11:04.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:11:04.163256634Z [2024-04-03T04:11:04.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:10:00+00:00, run_id=scheduled__2024-04-03T04:10:00+00:00, run_start_date=2024-04-03 04:11:00.175615+00:00, run_end_date=2024-04-03 04:11:04.162831+00:00, run_duration=3.987216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:10:00+00:00, data_interval_end=2024-04-03 04:11:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:11:04.179960388Z [2024-04-03T04:11:04.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:11:00+00:00, run_after=2024-04-03T04:12:00+00:00 2024-04-03T04:11:04.206189088Z [2024-04-03T04:11:04.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status success for try_number 1 2024-04-03T04:11:04.210765326Z [2024-04-03T04:11:04.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:10:00+00:00, map_index=-1, run_start_date=2024-04-03 04:11:02.280639+00:00, run_end_date=2024-04-03 04:11:03.933405+00:00, run_duration=1.652766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:11:00.220564+00:00, queued_by_job_id=1, pid=12688 2024-04-03T04:11:04.731630663Z [2024-04-03T04:11:04.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status success for try_number 1 2024-04-03T04:11:04.736982388Z [2024-04-03T04:11:04.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:10:00+00:00, map_index=-1, run_start_date=2024-04-03 04:11:02.172757+00:00, run_end_date=2024-04-03 04:11:04.094225+00:00, run_duration=1.921468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:11:00.220564+00:00, queued_by_job_id=1, pid=12687 2024-04-03T04:11:36.650954545Z [2024-04-03T04:11:36.650+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T04:12:01.041489741Z [2024-04-03T04:12:01.040+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:12:01.051309687Z [2024-04-03T04:12:01.050+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:12:01.066578363Z [2024-04-03T04:12:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:12:00+00:00, run_after=2024-04-03T04:13:00+00:00 2024-04-03T04:12:01.138969295Z [2024-04-03T04:12:01.138+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:12:01.138994662Z 2024-04-03T04:12:01.138998770Z 2024-04-03T04:12:01.139002117Z 2024-04-03T04:12:01.139166006Z [2024-04-03T04:12:01.138+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:12:01.139190547Z [2024-04-03T04:12:01.138+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:12:01.139237896Z [2024-04-03T04:12:01.139+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:12:01.139705220Z [2024-04-03T04:12:01.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:12:01.139716078Z 2024-04-03T04:12:01.139719646Z 2024-04-03T04:12:01.139722729Z 2024-04-03T04:12:01.144021386Z [2024-04-03T04:12:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:12:01.144138643Z [2024-04-03T04:12:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:12:01.144393707Z [2024-04-03T04:12:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:12:01.144505644Z [2024-04-03T04:12:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:12:01.144715010Z [2024-04-03T04:12:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:12:01.144749130Z [2024-04-03T04:12:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:12:01.508284867Z [2024-04-03T04:12:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status queued for try_number 1 2024-04-03T04:12:01.508308738Z [2024-04-03T04:12:01.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:11:00+00:00 exited with status queued for try_number 1 2024-04-03T04:12:01.508378495Z [2024-04-03T04:12:01.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:11:00+00:00 exited with status queued for try_number 1 2024-04-03T04:12:01.516476868Z [2024-04-03T04:12:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b3e5ef5-8ae9-4912-87a6-2c79a97104a1 2024-04-03T04:12:01.516570248Z [2024-04-03T04:12:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6650f0f7-725c-4b37-af89-db421c693906 2024-04-03T04:12:01.516670968Z [2024-04-03T04:12:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59734422-a134-4aa6-ab96-4485368d3e63 2024-04-03T04:12:02.673614481Z [2024-04-03T04:12:02.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:12:02.673883561Z [2024-04-03T04:12:02.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:10:00+00:00, run_id=scheduled__2024-04-03T04:10:00+00:00, run_start_date=2024-04-03 04:12:01.079604+00:00, run_end_date=2024-04-03 04:12:02.673523+00:00, run_duration=1.593919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:10:00+00:00, data_interval_end=2024-04-03 04:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:12:02.682009461Z [2024-04-03T04:12:02.681+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:12:00+00:00, run_after=2024-04-03T04:14:00+00:00 2024-04-03T04:12:02.723457057Z [2024-04-03T04:12:02.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status success for try_number 1 2024-04-03T04:12:02.732284834Z [2024-04-03T04:12:02.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:10:00+00:00, map_index=-1, run_start_date=2024-04-03 04:12:02.138512+00:00, run_end_date=2024-04-03 04:12:02.497180+00:00, run_duration=0.358668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:12:01.140456+00:00, queued_by_job_id=1, pid=12723 2024-04-03T04:12:06.046360340Z [2024-04-03T04:12:06.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:12:06.046556351Z [2024-04-03T04:12:06.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:11:00+00:00, run_id=scheduled__2024-04-03T04:11:00+00:00, run_start_date=2024-04-03 04:12:01.082256+00:00, run_end_date=2024-04-03 04:12:06.046167+00:00, run_duration=4.963911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:11:00+00:00, data_interval_end=2024-04-03 04:12:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:12:06.060106202Z [2024-04-03T04:12:06.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:12:00+00:00, run_after=2024-04-03T04:13:00+00:00 2024-04-03T04:12:06.070089819Z [2024-04-03T04:12:06.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:12:06.070633580Z [2024-04-03T04:12:06.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:11:00+00:00, run_id=scheduled__2024-04-03T04:11:00+00:00, run_start_date=2024-04-03 04:12:01.081188+00:00, run_end_date=2024-04-03 04:12:06.070235+00:00, run_duration=4.989047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:11:00+00:00, data_interval_end=2024-04-03 04:12:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:12:06.083527453Z [2024-04-03T04:12:06.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:12:00+00:00, run_after=2024-04-03T04:13:00+00:00 2024-04-03T04:12:06.129526015Z [2024-04-03T04:12:06.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:11:00+00:00 exited with status success for try_number 1 2024-04-03T04:12:06.130109859Z [2024-04-03T04:12:06.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:11:00+00:00 exited with status success for try_number 1 2024-04-03T04:12:06.138509270Z [2024-04-03T04:12:06.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:11:00+00:00, map_index=-1, run_start_date=2024-04-03 04:12:03.723817+00:00, run_end_date=2024-04-03 04:12:05.340650+00:00, run_duration=1.616833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:12:01.140456+00:00, queued_by_job_id=1, pid=12754 2024-04-03T04:12:06.138766365Z [2024-04-03T04:12:06.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:11:00+00:00, map_index=-1, run_start_date=2024-04-03 04:12:03.662193+00:00, run_end_date=2024-04-03 04:12:05.908331+00:00, run_duration=2.246138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:12:01.140456+00:00, queued_by_job_id=1, pid=12753 2024-04-03T04:13:00.688159398Z [2024-04-03T04:13:00.687+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:13:00.708745269Z [2024-04-03T04:13:00.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:13:00+00:00, run_after=2024-04-03T04:14:00+00:00 2024-04-03T04:13:00.810730462Z [2024-04-03T04:13:00.807+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:13:00.810772770Z 2024-04-03T04:13:00.810776294Z 2024-04-03T04:13:00.810780043Z [2024-04-03T04:13:00.807+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:13:00.810783112Z [2024-04-03T04:13:00.807+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:13:00.810787230Z [2024-04-03T04:13:00.808+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:13:00.810790334Z 2024-04-03T04:13:00.810793178Z 2024-04-03T04:13:00.814598672Z [2024-04-03T04:13:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:13:00.814620463Z [2024-04-03T04:13:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:13:00.814624104Z [2024-04-03T04:13:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:13:00.814627305Z [2024-04-03T04:13:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:13:01.149629493Z [2024-04-03T04:13:01.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:12:00+00:00 exited with status queued for try_number 1 2024-04-03T04:13:01.151085130Z [2024-04-03T04:13:01.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:12:00+00:00 exited with status queued for try_number 1 2024-04-03T04:13:01.168174474Z [2024-04-03T04:13:01.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba3d2172-eb2a-47de-a912-e8d0550b37d6 2024-04-03T04:13:01.172479062Z [2024-04-03T04:13:01.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf5b52ad-9297-459e-84b6-438bfc4a563d 2024-04-03T04:13:06.251190524Z [2024-04-03T04:13:06.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:13:06.251551430Z [2024-04-03T04:13:06.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:12:00+00:00, run_id=scheduled__2024-04-03T04:12:00+00:00, run_start_date=2024-04-03 04:13:00.731209+00:00, run_end_date=2024-04-03 04:13:06.250840+00:00, run_duration=5.519631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:12:00+00:00, data_interval_end=2024-04-03 04:13:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:13:06.262002304Z [2024-04-03T04:13:06.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:13:00+00:00, run_after=2024-04-03T04:14:00+00:00 2024-04-03T04:13:06.272175093Z [2024-04-03T04:13:06.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:13:06.272630238Z [2024-04-03T04:13:06.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:12:00+00:00, run_id=scheduled__2024-04-03T04:12:00+00:00, run_start_date=2024-04-03 04:13:00.732761+00:00, run_end_date=2024-04-03 04:13:06.271907+00:00, run_duration=5.539146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:12:00+00:00, data_interval_end=2024-04-03 04:13:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:13:06.291184649Z [2024-04-03T04:13:06.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:13:00+00:00, run_after=2024-04-03T04:14:00+00:00 2024-04-03T04:13:06.335243384Z [2024-04-03T04:13:06.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:12:00+00:00 exited with status success for try_number 1 2024-04-03T04:13:06.335563072Z [2024-04-03T04:13:06.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:12:00+00:00 exited with status success for try_number 1 2024-04-03T04:13:06.346614034Z [2024-04-03T04:13:06.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:12:00+00:00, map_index=-1, run_start_date=2024-04-03 04:13:03.773034+00:00, run_end_date=2024-04-03 04:13:05.622306+00:00, run_duration=1.849272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:13:00.809223+00:00, queued_by_job_id=1, pid=12809 2024-04-03T04:13:06.347282334Z [2024-04-03T04:13:06.346+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:12:00+00:00, map_index=-1, run_start_date=2024-04-03 04:13:03.925283+00:00, run_end_date=2024-04-03 04:13:06.094326+00:00, run_duration=2.169043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:13:00.809223+00:00, queued_by_job_id=1, pid=12810 2024-04-03T04:14:00.263920763Z [2024-04-03T04:14:00.263+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:14:00.277893186Z [2024-04-03T04:14:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:14:00+00:00, run_after=2024-04-03T04:15:00+00:00 2024-04-03T04:14:00.285173675Z [2024-04-03T04:14:00.284+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:14:00.354232808Z [2024-04-03T04:14:00.353+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:14:00.354269698Z 2024-04-03T04:14:00.354273979Z 2024-04-03T04:14:00.354277419Z 2024-04-03T04:14:00.354505120Z [2024-04-03T04:14:00.354+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:14:00.354769967Z [2024-04-03T04:14:00.354+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:14:00.355015006Z [2024-04-03T04:14:00.354+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:14:00.355654255Z [2024-04-03T04:14:00.355+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:14:00.355665084Z 2024-04-03T04:14:00.355668651Z 2024-04-03T04:14:00.355671736Z 2024-04-03T04:14:00.359180696Z [2024-04-03T04:14:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:14:00.359418265Z [2024-04-03T04:14:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:14:00.359741156Z [2024-04-03T04:14:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:14:00.359942898Z [2024-04-03T04:14:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:14:00.360314794Z [2024-04-03T04:14:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:14:00.360514410Z [2024-04-03T04:14:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:14:00.652469714Z [2024-04-03T04:14:00.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:12:00+00:00 exited with status queued for try_number 1 2024-04-03T04:14:00.652506883Z [2024-04-03T04:14:00.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:13:00+00:00 exited with status queued for try_number 1 2024-04-03T04:14:00.652555130Z [2024-04-03T04:14:00.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:13:00+00:00 exited with status queued for try_number 1 2024-04-03T04:14:00.670848556Z [2024-04-03T04:14:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54ad3d2d-f84d-4d54-b873-2e8543299b18 2024-04-03T04:14:00.670892058Z [2024-04-03T04:14:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab77dbfe-7732-4d56-a530-24e32cfa06db 2024-04-03T04:14:00.671010394Z [2024-04-03T04:14:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d33c9fb-44fa-4844-b163-6a8dad26ad3b 2024-04-03T04:14:01.978624746Z [2024-04-03T04:14:01.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:14:01.979057942Z [2024-04-03T04:14:01.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:12:00+00:00, run_id=scheduled__2024-04-03T04:12:00+00:00, run_start_date=2024-04-03 04:14:00.294474+00:00, run_end_date=2024-04-03 04:14:01.978646+00:00, run_duration=1.684172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:12:00+00:00, data_interval_end=2024-04-03 04:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:14:01.996868083Z [2024-04-03T04:14:01.996+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:14:00+00:00, run_after=2024-04-03T04:16:00+00:00 2024-04-03T04:14:02.166229320Z [2024-04-03T04:14:02.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:12:00+00:00 exited with status success for try_number 1 2024-04-03T04:14:02.176970801Z [2024-04-03T04:14:02.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:12:00+00:00, map_index=-1, run_start_date=2024-04-03 04:14:01.498858+00:00, run_end_date=2024-04-03 04:14:01.898352+00:00, run_duration=0.399494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:14:00.356448+00:00, queued_by_job_id=1, pid=12845 2024-04-03T04:14:05.482953196Z [2024-04-03T04:14:05.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:14:05.483208220Z [2024-04-03T04:14:05.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:13:00+00:00, run_id=scheduled__2024-04-03T04:13:00+00:00, run_start_date=2024-04-03 04:14:00.297103+00:00, run_end_date=2024-04-03 04:14:05.482847+00:00, run_duration=5.185744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:13:00+00:00, data_interval_end=2024-04-03 04:14:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:14:05.493597255Z [2024-04-03T04:14:05.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:14:00+00:00, run_after=2024-04-03T04:15:00+00:00 2024-04-03T04:14:05.499773320Z [2024-04-03T04:14:05.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:14:05.500122971Z [2024-04-03T04:14:05.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:13:00+00:00, run_id=scheduled__2024-04-03T04:13:00+00:00, run_start_date=2024-04-03 04:14:00.295663+00:00, run_end_date=2024-04-03 04:14:05.499698+00:00, run_duration=5.204035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:13:00+00:00, data_interval_end=2024-04-03 04:14:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:14:05.509944512Z [2024-04-03T04:14:05.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:14:00+00:00, run_after=2024-04-03T04:15:00+00:00 2024-04-03T04:14:05.540413364Z [2024-04-03T04:14:05.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:13:00+00:00 exited with status success for try_number 1 2024-04-03T04:14:05.541206090Z [2024-04-03T04:14:05.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:13:00+00:00 exited with status success for try_number 1 2024-04-03T04:14:05.550109878Z [2024-04-03T04:14:05.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:13:00+00:00, map_index=-1, run_start_date=2024-04-03 04:14:03.047324+00:00, run_end_date=2024-04-03 04:14:04.905492+00:00, run_duration=1.858168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:14:00.356448+00:00, queued_by_job_id=1, pid=12885 2024-04-03T04:14:05.550281132Z [2024-04-03T04:14:05.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:13:00+00:00, map_index=-1, run_start_date=2024-04-03 04:14:02.545819+00:00, run_end_date=2024-04-03 04:14:04.604547+00:00, run_duration=2.058728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:14:00.356448+00:00, queued_by_job_id=1, pid=12866 2024-04-03T04:15:00.099551117Z [2024-04-03T04:15:00.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:15:00+00:00, run_after=2024-04-03T04:20:00+00:00 2024-04-03T04:15:00.108970602Z [2024-04-03T04:15:00.108+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:15:00.127165099Z [2024-04-03T04:15:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:15:00+00:00, run_after=2024-04-03T04:16:00+00:00 2024-04-03T04:15:00.254047140Z [2024-04-03T04:15:00.253+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:15:00.254081611Z 2024-04-03T04:15:00.254090683Z 2024-04-03T04:15:00.254094001Z 2024-04-03T04:15:00.254661773Z [2024-04-03T04:15:00.253+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:15:00.254957726Z [2024-04-03T04:15:00.254+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:15:00.255182733Z [2024-04-03T04:15:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:15:00.255937790Z [2024-04-03T04:15:00.255+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:15:00.255944013Z 2024-04-03T04:15:00.255947542Z 2024-04-03T04:15:00.255950666Z 2024-04-03T04:15:00.260240061Z [2024-04-03T04:15:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T04:15:00.260791595Z [2024-04-03T04:15:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:15:00.261116144Z [2024-04-03T04:15:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:15:00.261218857Z [2024-04-03T04:15:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:15:00.261500397Z [2024-04-03T04:15:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:15:00.261579186Z [2024-04-03T04:15:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:15:00.538102185Z [2024-04-03T04:15:00.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status queued for try_number 1 2024-04-03T04:15:00.538416681Z [2024-04-03T04:15:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:14:00+00:00 exited with status queued for try_number 1 2024-04-03T04:15:00.538616943Z [2024-04-03T04:15:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:14:00+00:00 exited with status queued for try_number 1 2024-04-03T04:15:00.551089759Z [2024-04-03T04:15:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a4ec916-8e39-4f4e-aa8d-b26171bd4c95 2024-04-03T04:15:00.551330716Z [2024-04-03T04:15:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9cd8d67-8f51-403a-8fb1-8bd614317829 2024-04-03T04:15:00.551527969Z [2024-04-03T04:15:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to e69505d7-d5f7-44cd-9fcb-9f3ec8fe6b4d 2024-04-03T04:15:04.355621969Z [2024-04-03T04:15:04.355+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:15:04.355666001Z 2024-04-03T04:15:04.355912160Z [2024-04-03T04:15:04.355+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:15:04.357206991Z [2024-04-03T04:15:04.356+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:15:04.357219652Z 2024-04-03T04:15:04.360942543Z [2024-04-03T04:15:04.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T04:15:04.361124383Z [2024-04-03T04:15:04.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:15:04.449572763Z [2024-04-03T04:15:04.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status queued for try_number 1 2024-04-03T04:15:04.457488600Z [2024-04-03T04:15:04.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status success for try_number 1 2024-04-03T04:15:04.482807381Z [2024-04-03T04:15:04.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c3ff60b-9388-4a5e-b785-00910b2265d5 2024-04-03T04:15:04.483572295Z [2024-04-03T04:15:04.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T04:10:00+00:00, map_index=-1, run_start_date=2024-04-03 04:15:02.578813+00:00, run_end_date=2024-04-03 04:15:03.135469+00:00, run_duration=0.556656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:15:00.257493+00:00, queued_by_job_id=1, pid=12932 2024-04-03T04:15:04.539198280Z [2024-04-03T04:15:04.538+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:15:04.539524084Z [2024-04-03T04:15:04.539+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:14:00+00:00, run_id=scheduled__2024-04-03T04:14:00+00:00, run_start_date=2024-04-03 04:15:00.158507+00:00, run_end_date=2024-04-03 04:15:04.539192+00:00, run_duration=4.380685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:14:00+00:00, data_interval_end=2024-04-03 04:15:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:15:04.556806811Z [2024-04-03T04:15:04.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:15:00+00:00, run_after=2024-04-03T04:16:00+00:00 2024-04-03T04:15:05.806556933Z [2024-04-03T04:15:05.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:14:00+00:00 exited with status success for try_number 1 2024-04-03T04:15:05.813234731Z [2024-04-03T04:15:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:14:00+00:00, map_index=-1, run_start_date=2024-04-03 04:15:02.807309+00:00, run_end_date=2024-04-03 04:15:04.479854+00:00, run_duration=1.672545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:15:00.257493+00:00, queued_by_job_id=1, pid=12933 2024-04-03T04:15:06.878565849Z [2024-04-03T04:15:06.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:15:06.878895944Z [2024-04-03T04:15:06.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:14:00+00:00, run_id=scheduled__2024-04-03T04:14:00+00:00, run_start_date=2024-04-03 04:15:00.161080+00:00, run_end_date=2024-04-03 04:15:06.878341+00:00, run_duration=6.717261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:14:00+00:00, data_interval_end=2024-04-03 04:15:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:15:06.889996051Z [2024-04-03T04:15:06.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:15:00+00:00, run_after=2024-04-03T04:16:00+00:00 2024-04-03T04:15:06.922929569Z [2024-04-03T04:15:06.922+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:15:06.922963945Z 2024-04-03T04:15:06.923264544Z [2024-04-03T04:15:06.922+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:15:06.924753876Z [2024-04-03T04:15:06.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:15:06.924769116Z 2024-04-03T04:15:06.930010538Z [2024-04-03T04:15:06.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T04:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T04:15:06.930336098Z [2024-04-03T04:15:06.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:15:06.984748723Z [2024-04-03T04:15:06.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status queued for try_number 1 2024-04-03T04:15:06.984975923Z [2024-04-03T04:15:06.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:14:00+00:00 exited with status success for try_number 1 2024-04-03T04:15:06.985183559Z [2024-04-03T04:15:06.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status success for try_number 1 2024-04-03T04:15:06.993534052Z [2024-04-03T04:15:06.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:14:00+00:00, map_index=-1, run_start_date=2024-04-03 04:15:03.696032+00:00, run_end_date=2024-04-03 04:15:05.813408+00:00, run_duration=2.117376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:15:00.257493+00:00, queued_by_job_id=1, pid=12961 2024-04-03T04:15:06.993850612Z [2024-04-03T04:15:06.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T04:10:00+00:00, map_index=-1, run_start_date=2024-04-03 04:15:06.253902+00:00, run_end_date=2024-04-03 04:15:06.659936+00:00, run_duration=0.406034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:15:04.357885+00:00, queued_by_job_id=1, pid=12982 2024-04-03T04:15:06.994176139Z [2024-04-03T04:15:06.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee315a7b-95e4-49a0-8a8a-f56c46645b62 2024-04-03T04:15:10.447094794Z [2024-04-03T04:15:10.446+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:15:10.447131978Z 2024-04-03T04:15:10.447472631Z [2024-04-03T04:15:10.447+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:15:10.449196282Z [2024-04-03T04:15:10.448+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:15:10.449215686Z 2024-04-03T04:15:10.452481493Z [2024-04-03T04:15:10.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:15:10.452804225Z [2024-04-03T04:15:10.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:15:10.533043925Z [2024-04-03T04:15:10.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status queued for try_number 1 2024-04-03T04:15:10.533432131Z [2024-04-03T04:15:10.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status success for try_number 1 2024-04-03T04:15:10.539691233Z [2024-04-03T04:15:10.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c480e12-1136-4548-bee4-c4c56b7c6440 2024-04-03T04:15:10.540136105Z [2024-04-03T04:15:10.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T04:10:00+00:00, map_index=0, run_start_date=2024-04-03 04:15:08.848635+00:00, run_end_date=2024-04-03 04:15:10.138267+00:00, run_duration=1.289632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:15:06.925700+00:00, queued_by_job_id=1, pid=12994 2024-04-03T04:15:14.580957361Z [2024-04-03T04:15:14.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:15:14.581578163Z [2024-04-03T04:15:14.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:10:00+00:00, run_id=scheduled__2024-04-03T04:10:00+00:00, run_start_date=2024-04-03 04:15:00.146840+00:00, run_end_date=2024-04-03 04:15:14.580843+00:00, run_duration=14.434003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:10:00+00:00, data_interval_end=2024-04-03 04:15:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T04:15:14.588297409Z [2024-04-03T04:15:14.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:15:00+00:00, run_after=2024-04-03T04:20:00+00:00 2024-04-03T04:15:14.631204322Z [2024-04-03T04:15:14.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T04:10:00+00:00 exited with status success for try_number 1 2024-04-03T04:15:14.639031949Z [2024-04-03T04:15:14.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T04:10:00+00:00, map_index=-1, run_start_date=2024-04-03 04:15:12.763376+00:00, run_end_date=2024-04-03 04:15:13.401005+00:00, run_duration=0.637629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:15:10.449697+00:00, queued_by_job_id=1, pid=13015 2024-04-03T04:16:00.143406565Z [2024-04-03T04:16:00.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:16:00+00:00, run_after=2024-04-03T04:17:00+00:00 2024-04-03T04:16:00.172153488Z [2024-04-03T04:16:00.171+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:16:00.181046178Z [2024-04-03T04:16:00.180+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:16:00.254152574Z [2024-04-03T04:16:00.253+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:16:00.254175985Z 2024-04-03T04:16:00.254180092Z 2024-04-03T04:16:00.254183387Z 2024-04-03T04:16:00.254266907Z [2024-04-03T04:16:00.254+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:16:00.254448469Z [2024-04-03T04:16:00.254+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:16:00.254584930Z [2024-04-03T04:16:00.254+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:16:00.255228132Z [2024-04-03T04:16:00.255+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:16:00.255246714Z 2024-04-03T04:16:00.255250442Z 2024-04-03T04:16:00.255253471Z 2024-04-03T04:16:00.258966646Z [2024-04-03T04:16:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:16:00.259174620Z [2024-04-03T04:16:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:16:00.259473914Z [2024-04-03T04:16:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:16:00.259601625Z [2024-04-03T04:16:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:16:00.259862340Z [2024-04-03T04:16:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:16:00.260037764Z [2024-04-03T04:16:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:16:00.539829745Z [2024-04-03T04:16:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:14:00+00:00 exited with status queued for try_number 1 2024-04-03T04:16:00.539923439Z [2024-04-03T04:16:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status queued for try_number 1 2024-04-03T04:16:00.540001619Z [2024-04-03T04:16:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status queued for try_number 1 2024-04-03T04:16:00.549895131Z [2024-04-03T04:16:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21c3e336-eddc-4f3c-9ccb-14af5bb8137e 2024-04-03T04:16:00.549975873Z [2024-04-03T04:16:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ef51c9b-c62a-43e4-8f6c-66d4e82b2ecc 2024-04-03T04:16:00.550053337Z [2024-04-03T04:16:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2debcc95-f835-46c5-8109-200dff426359 2024-04-03T04:16:02.794719647Z [2024-04-03T04:16:02.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:16:02.794742146Z [2024-04-03T04:16:02.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:14:00+00:00, run_id=scheduled__2024-04-03T04:14:00+00:00, run_start_date=2024-04-03 04:16:00.204602+00:00, run_end_date=2024-04-03 04:16:02.787558+00:00, run_duration=2.582956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:14:00+00:00, data_interval_end=2024-04-03 04:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:16:02.798880069Z [2024-04-03T04:16:02.797+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:16:00+00:00, run_after=2024-04-03T04:18:00+00:00 2024-04-03T04:16:02.891454776Z [2024-04-03T04:16:02.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:14:00+00:00 exited with status success for try_number 1 2024-04-03T04:16:02.898014484Z [2024-04-03T04:16:02.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:14:00+00:00, map_index=-1, run_start_date=2024-04-03 04:16:01.139856+00:00, run_end_date=2024-04-03 04:16:01.600812+00:00, run_duration=0.460956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:16:00.255892+00:00, queued_by_job_id=1, pid=13032 2024-04-03T04:16:04.120244734Z [2024-04-03T04:16:04.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:16:04.120486091Z [2024-04-03T04:16:04.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:15:00+00:00, run_id=scheduled__2024-04-03T04:15:00+00:00, run_start_date=2024-04-03 04:16:00.205846+00:00, run_end_date=2024-04-03 04:16:04.120149+00:00, run_duration=3.914303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:15:00+00:00, data_interval_end=2024-04-03 04:16:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:16:04.133171697Z [2024-04-03T04:16:04.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:16:00+00:00, run_after=2024-04-03T04:17:00+00:00 2024-04-03T04:16:05.274068192Z [2024-04-03T04:16:05.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status success for try_number 1 2024-04-03T04:16:05.278734802Z [2024-04-03T04:16:05.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:15:00+00:00, map_index=-1, run_start_date=2024-04-03 04:16:02.538824+00:00, run_end_date=2024-04-03 04:16:04.084961+00:00, run_duration=1.546137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:16:00.255892+00:00, queued_by_job_id=1, pid=13060 2024-04-03T04:16:06.080658870Z [2024-04-03T04:16:06.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:16:06.082002538Z [2024-04-03T04:16:06.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:15:00+00:00, run_id=scheduled__2024-04-03T04:15:00+00:00, run_start_date=2024-04-03 04:16:00.207211+00:00, run_end_date=2024-04-03 04:16:06.080542+00:00, run_duration=5.873331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:15:00+00:00, data_interval_end=2024-04-03 04:16:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:16:06.091899729Z [2024-04-03T04:16:06.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:16:00+00:00, run_after=2024-04-03T04:17:00+00:00 2024-04-03T04:16:06.121501693Z [2024-04-03T04:16:06.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status success for try_number 1 2024-04-03T04:16:06.127918221Z [2024-04-03T04:16:06.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:15:00+00:00, map_index=-1, run_start_date=2024-04-03 04:16:02.727034+00:00, run_end_date=2024-04-03 04:16:05.327836+00:00, run_duration=2.600802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:16:00.255892+00:00, queued_by_job_id=1, pid=13063 2024-04-03T04:16:36.708002685Z [2024-04-03T04:16:36.702+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T04:17:00.935921224Z [2024-04-03T04:17:00.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:17:00+00:00, run_after=2024-04-03T04:18:00+00:00 2024-04-03T04:17:00.948134649Z [2024-04-03T04:17:00.947+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:17:01.028203311Z [2024-04-03T04:17:01.027+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:17:01.028223461Z 2024-04-03T04:17:01.028227072Z 2024-04-03T04:17:01.028456532Z [2024-04-03T04:17:01.028+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:17:01.028696428Z [2024-04-03T04:17:01.028+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:17:01.029302005Z [2024-04-03T04:17:01.029+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:17:01.029312579Z 2024-04-03T04:17:01.029316054Z 2024-04-03T04:17:01.032195239Z [2024-04-03T04:17:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:17:01.032575170Z [2024-04-03T04:17:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:17:01.032908990Z [2024-04-03T04:17:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:17:01.033103318Z [2024-04-03T04:17:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:17:01.382549869Z [2024-04-03T04:17:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:16:00+00:00 exited with status queued for try_number 1 2024-04-03T04:17:01.382609330Z [2024-04-03T04:17:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:16:00+00:00 exited with status queued for try_number 1 2024-04-03T04:17:01.399986835Z [2024-04-03T04:17:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcda4824-7d55-4304-9ab3-1cae2fcb6a02 2024-04-03T04:17:01.400161044Z [2024-04-03T04:17:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to 080e9385-6e82-4bb9-a207-37104fb8d46d 2024-04-03T04:17:06.011363044Z [2024-04-03T04:17:06.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:17:06.011610647Z [2024-04-03T04:17:06.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:16:00+00:00, run_id=scheduled__2024-04-03T04:16:00+00:00, run_start_date=2024-04-03 04:17:00.958512+00:00, run_end_date=2024-04-03 04:17:06.011154+00:00, run_duration=5.052642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:16:00+00:00, data_interval_end=2024-04-03 04:17:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:17:06.021369693Z [2024-04-03T04:17:06.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:17:00+00:00, run_after=2024-04-03T04:18:00+00:00 2024-04-03T04:17:06.027592918Z [2024-04-03T04:17:06.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:17:06.027836665Z [2024-04-03T04:17:06.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:16:00+00:00, run_id=scheduled__2024-04-03T04:16:00+00:00, run_start_date=2024-04-03 04:17:00.959726+00:00, run_end_date=2024-04-03 04:17:06.027450+00:00, run_duration=5.067724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:16:00+00:00, data_interval_end=2024-04-03 04:17:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:17:06.037579959Z [2024-04-03T04:17:06.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:17:00+00:00, run_after=2024-04-03T04:18:00+00:00 2024-04-03T04:17:06.079588382Z [2024-04-03T04:17:06.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:16:00+00:00 exited with status success for try_number 1 2024-04-03T04:17:06.079641222Z [2024-04-03T04:17:06.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:16:00+00:00 exited with status success for try_number 1 2024-04-03T04:17:06.085412516Z [2024-04-03T04:17:06.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:16:00+00:00, map_index=-1, run_start_date=2024-04-03 04:17:03.182749+00:00, run_end_date=2024-04-03 04:17:05.021150+00:00, run_duration=1.838401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:17:01.029924+00:00, queued_by_job_id=1, pid=13117 2024-04-03T04:17:06.085551275Z [2024-04-03T04:17:06.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:16:00+00:00, map_index=-1, run_start_date=2024-04-03 04:17:03.368617+00:00, run_end_date=2024-04-03 04:17:05.843914+00:00, run_duration=2.475297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:17:01.029924+00:00, queued_by_job_id=1, pid=13118 2024-04-03T04:18:00.500930413Z [2024-04-03T04:18:00.500+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:18:00.507994880Z [2024-04-03T04:18:00.507+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:18:00.520890025Z [2024-04-03T04:18:00.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:18:00+00:00, run_after=2024-04-03T04:19:00+00:00 2024-04-03T04:18:00.578965748Z [2024-04-03T04:18:00.578+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:18:00.579002560Z 2024-04-03T04:18:00.579006636Z 2024-04-03T04:18:00.579010372Z 2024-04-03T04:18:00.579079792Z [2024-04-03T04:18:00.578+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:18:00.579222878Z [2024-04-03T04:18:00.579+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:18:00.579358107Z [2024-04-03T04:18:00.579+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:18:00.580122577Z [2024-04-03T04:18:00.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:18:00.580154546Z 2024-04-03T04:18:00.580164500Z 2024-04-03T04:18:00.580173469Z 2024-04-03T04:18:00.583957505Z [2024-04-03T04:18:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:18:00.584105150Z [2024-04-03T04:18:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:18:00.584379463Z [2024-04-03T04:18:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:18:00.584522349Z [2024-04-03T04:18:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:18:00.584749245Z [2024-04-03T04:18:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:18:00.584882557Z [2024-04-03T04:18:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:18:00.939904909Z [2024-04-03T04:18:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:16:00+00:00 exited with status queued for try_number 1 2024-04-03T04:18:00.942022884Z [2024-04-03T04:18:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:17:00+00:00 exited with status queued for try_number 1 2024-04-03T04:18:00.942138084Z [2024-04-03T04:18:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:17:00+00:00 exited with status queued for try_number 1 2024-04-03T04:18:00.950614392Z [2024-04-03T04:18:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c0ef96a-e2e7-427d-b474-902fdbeb7cff 2024-04-03T04:18:00.950892169Z [2024-04-03T04:18:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcf8021d-f3a0-4772-a10a-e35d193d0547 2024-04-03T04:18:00.952433560Z [2024-04-03T04:18:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3086670c-658a-44f2-97c0-7d1ac57d237e 2024-04-03T04:18:03.313522921Z [2024-04-03T04:18:03.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:18:03.313824975Z [2024-04-03T04:18:03.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:16:00+00:00, run_id=scheduled__2024-04-03T04:16:00+00:00, run_start_date=2024-04-03 04:18:00.530949+00:00, run_end_date=2024-04-03 04:18:03.313452+00:00, run_duration=2.782503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:16:00+00:00, data_interval_end=2024-04-03 04:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:18:03.321679784Z [2024-04-03T04:18:03.321+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:18:00+00:00, run_after=2024-04-03T04:20:00+00:00 2024-04-03T04:18:03.365811288Z [2024-04-03T04:18:03.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:16:00+00:00 exited with status success for try_number 1 2024-04-03T04:18:03.370671770Z [2024-04-03T04:18:03.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:16:00+00:00, map_index=-1, run_start_date=2024-04-03 04:18:02.085026+00:00, run_end_date=2024-04-03 04:18:02.461379+00:00, run_duration=0.376353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:18:00.580912+00:00, queued_by_job_id=1, pid=13155 2024-04-03T04:18:05.521848382Z [2024-04-03T04:18:05.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:18:05.522270564Z [2024-04-03T04:18:05.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:17:00+00:00, run_id=scheduled__2024-04-03T04:17:00+00:00, run_start_date=2024-04-03 04:18:00.533344+00:00, run_end_date=2024-04-03 04:18:05.521850+00:00, run_duration=4.988506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:17:00+00:00, data_interval_end=2024-04-03 04:18:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:18:05.535612843Z [2024-04-03T04:18:05.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:18:00+00:00, run_after=2024-04-03T04:19:00+00:00 2024-04-03T04:18:05.552900314Z [2024-04-03T04:18:05.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:18:05.553143383Z [2024-04-03T04:18:05.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:17:00+00:00, run_id=scheduled__2024-04-03T04:17:00+00:00, run_start_date=2024-04-03 04:18:00.532247+00:00, run_end_date=2024-04-03 04:18:05.552861+00:00, run_duration=5.020614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:17:00+00:00, data_interval_end=2024-04-03 04:18:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:18:05.568367425Z [2024-04-03T04:18:05.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:18:00+00:00, run_after=2024-04-03T04:19:00+00:00 2024-04-03T04:18:05.615668388Z [2024-04-03T04:18:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:17:00+00:00 exited with status success for try_number 1 2024-04-03T04:18:05.616353928Z [2024-04-03T04:18:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:17:00+00:00 exited with status success for try_number 1 2024-04-03T04:18:05.626338620Z [2024-04-03T04:18:05.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:17:00+00:00, map_index=-1, run_start_date=2024-04-03 04:18:02.967041+00:00, run_end_date=2024-04-03 04:18:04.570490+00:00, run_duration=1.603449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:18:00.580912+00:00, queued_by_job_id=1, pid=13184 2024-04-03T04:18:05.626498408Z [2024-04-03T04:18:05.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:17:00+00:00, map_index=-1, run_start_date=2024-04-03 04:18:02.893060+00:00, run_end_date=2024-04-03 04:18:05.046035+00:00, run_duration=2.152975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:18:00.580912+00:00, queued_by_job_id=1, pid=13183 2024-04-03T04:19:00.845787503Z [2024-04-03T04:19:00.845+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:19:00.863535554Z [2024-04-03T04:19:00.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:19:00+00:00, run_after=2024-04-03T04:20:00+00:00 2024-04-03T04:19:00.936001309Z [2024-04-03T04:19:00.935+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:19:00.936024295Z 2024-04-03T04:19:00.936028539Z 2024-04-03T04:19:00.936068734Z [2024-04-03T04:19:00.935+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:19:00.936183576Z [2024-04-03T04:19:00.936+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:19:00.936870459Z [2024-04-03T04:19:00.936+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:19:00.936878330Z 2024-04-03T04:19:00.936881758Z 2024-04-03T04:19:00.939876891Z [2024-04-03T04:19:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:19:00.940145167Z [2024-04-03T04:19:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:19:00.940513379Z [2024-04-03T04:19:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:19:00.940683323Z [2024-04-03T04:19:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:19:01.166708376Z [2024-04-03T04:19:01.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:18:00+00:00 exited with status queued for try_number 1 2024-04-03T04:19:01.166952681Z [2024-04-03T04:19:01.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:18:00+00:00 exited with status queued for try_number 1 2024-04-03T04:19:01.177281465Z [2024-04-03T04:19:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2cb3874-ea8e-4266-9553-7a8534c014a4 2024-04-03T04:19:01.177533051Z [2024-04-03T04:19:01.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20744b28-2d28-455d-a2af-f3721aa83e59 2024-04-03T04:19:05.077019372Z [2024-04-03T04:19:05.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:19:05.077893406Z [2024-04-03T04:19:05.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:18:00+00:00, run_id=scheduled__2024-04-03T04:18:00+00:00, run_start_date=2024-04-03 04:19:00.882395+00:00, run_end_date=2024-04-03 04:19:05.076889+00:00, run_duration=4.194494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:18:00+00:00, data_interval_end=2024-04-03 04:19:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:19:05.100610318Z [2024-04-03T04:19:05.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:19:00+00:00, run_after=2024-04-03T04:20:00+00:00 2024-04-03T04:19:05.142296344Z [2024-04-03T04:19:05.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:18:00+00:00 exited with status success for try_number 1 2024-04-03T04:19:05.147434378Z [2024-04-03T04:19:05.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:18:00+00:00, map_index=-1, run_start_date=2024-04-03 04:19:03.073602+00:00, run_end_date=2024-04-03 04:19:04.751796+00:00, run_duration=1.678194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:19:00.937423+00:00, queued_by_job_id=1, pid=13238 2024-04-03T04:19:06.211631948Z [2024-04-03T04:19:06.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:19:06.212046076Z [2024-04-03T04:19:06.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:18:00+00:00, run_id=scheduled__2024-04-03T04:18:00+00:00, run_start_date=2024-04-03 04:19:00.883870+00:00, run_end_date=2024-04-03 04:19:06.211527+00:00, run_duration=5.327657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:18:00+00:00, data_interval_end=2024-04-03 04:19:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:19:06.222017364Z [2024-04-03T04:19:06.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:19:00+00:00, run_after=2024-04-03T04:20:00+00:00 2024-04-03T04:19:06.252994678Z [2024-04-03T04:19:06.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:18:00+00:00 exited with status success for try_number 1 2024-04-03T04:19:06.258112710Z [2024-04-03T04:19:06.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:18:00+00:00, map_index=-1, run_start_date=2024-04-03 04:19:03.126239+00:00, run_end_date=2024-04-03 04:19:05.130247+00:00, run_duration=2.004008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:19:00.937423+00:00, queued_by_job_id=1, pid=13239 2024-04-03T04:20:00.135271279Z [2024-04-03T04:20:00.134+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:20:00.159241792Z [2024-04-03T04:20:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:20:00+00:00, run_after=2024-04-03T04:21:00+00:00 2024-04-03T04:20:00.181075083Z [2024-04-03T04:20:00.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:20:00+00:00, run_after=2024-04-03T04:25:00+00:00 2024-04-03T04:20:00.191400196Z [2024-04-03T04:20:00.190+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:20:00.264780612Z [2024-04-03T04:20:00.264+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-03T04:20:00.264806021Z 2024-04-03T04:20:00.264809483Z 2024-04-03T04:20:00.264813215Z 2024-04-03T04:20:00.264816243Z 2024-04-03T04:20:00.264873839Z [2024-04-03T04:20:00.264+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:20:00.265018737Z [2024-04-03T04:20:00.264+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:20:00.265141010Z [2024-04-03T04:20:00.264+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:20:00.265240886Z [2024-04-03T04:20:00.265+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:20:00.265905350Z [2024-04-03T04:20:00.265+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:20:00.265945423Z 2024-04-03T04:20:00.265951435Z 2024-04-03T04:20:00.265956403Z 2024-04-03T04:20:00.265975072Z 2024-04-03T04:20:00.269373265Z [2024-04-03T04:20:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-03T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-03T04:20:00.269621308Z [2024-04-03T04:20:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:20:00.269935739Z [2024-04-03T04:20:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:20:00.270117871Z [2024-04-03T04:20:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:20:00.270359503Z [2024-04-03T04:20:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:20:00.270505543Z [2024-04-03T04:20:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:20:00.270800570Z [2024-04-03T04:20:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:20:00.270965331Z [2024-04-03T04:20:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:20:00.669043062Z [2024-04-03T04:20:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status queued for try_number 1 2024-04-03T04:20:00.669205533Z [2024-04-03T04:20:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:18:00+00:00 exited with status queued for try_number 1 2024-04-03T04:20:00.669342668Z [2024-04-03T04:20:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:19:00+00:00 exited with status queued for try_number 1 2024-04-03T04:20:00.669476118Z [2024-04-03T04:20:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:19:00+00:00 exited with status queued for try_number 1 2024-04-03T04:20:00.683239938Z [2024-04-03T04:20:00.681+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ea4a4d4-5661-4b3a-b521-253a26c71a90 2024-04-03T04:20:00.683414462Z [2024-04-03T04:20:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ed18305-6eba-449c-80c6-e58649c78bfb 2024-04-03T04:20:00.683573688Z [2024-04-03T04:20:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f9f4ae4-5199-4321-9d39-e384344a891d 2024-04-03T04:20:00.683719493Z [2024-04-03T04:20:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d9d47ad-58d6-46a4-91a5-a60c562c075a 2024-04-03T04:20:02.609179956Z [2024-04-03T04:20:02.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:20:02.609867804Z [2024-04-03T04:20:02.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:18:00+00:00, run_id=scheduled__2024-04-03T04:18:00+00:00, run_start_date=2024-04-03 04:20:00.202823+00:00, run_end_date=2024-04-03 04:20:02.609381+00:00, run_duration=2.406558, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:18:00+00:00, data_interval_end=2024-04-03 04:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:20:02.628117064Z [2024-04-03T04:20:02.627+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:20:00+00:00, run_after=2024-04-03T04:22:00+00:00 2024-04-03T04:20:02.723770046Z [2024-04-03T04:20:02.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:18:00+00:00 exited with status success for try_number 1 2024-04-03T04:20:02.736934277Z [2024-04-03T04:20:02.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:18:00+00:00, map_index=-1, run_start_date=2024-04-03 04:20:01.303964+00:00, run_end_date=2024-04-03 04:20:02.088693+00:00, run_duration=0.784729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:20:00.266759+00:00, queued_by_job_id=1, pid=13275 2024-04-03T04:20:04.978546876Z [2024-04-03T04:20:04.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:20:04.978809717Z [2024-04-03T04:20:04.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:19:00+00:00, run_id=scheduled__2024-04-03T04:19:00+00:00, run_start_date=2024-04-03 04:20:00.204353+00:00, run_end_date=2024-04-03 04:20:04.978484+00:00, run_duration=4.774131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:19:00+00:00, data_interval_end=2024-04-03 04:20:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:20:04.990481076Z [2024-04-03T04:20:04.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:20:00+00:00, run_after=2024-04-03T04:21:00+00:00 2024-04-03T04:20:05.030640830Z [2024-04-03T04:20:05.030+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:20:05.030699601Z 2024-04-03T04:20:05.030881309Z [2024-04-03T04:20:05.030+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:20:05.031997920Z [2024-04-03T04:20:05.031+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:20:05.032027938Z 2024-04-03T04:20:05.036462248Z [2024-04-03T04:20:05.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='split_metrics', run_id='scheduled__2024-04-03T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-03T04:20:05.036756759Z [2024-04-03T04:20:05.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:20:05.091020054Z [2024-04-03T04:20:05.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status queued for try_number 1 2024-04-03T04:20:05.091302654Z [2024-04-03T04:20:05.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.extract_metrics_from_vnfrs run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status success for try_number 1 2024-04-03T04:20:05.091491525Z [2024-04-03T04:20:05.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:19:00+00:00 exited with status success for try_number 1 2024-04-03T04:20:05.099212757Z [2024-04-03T04:20:05.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-03T04:15:00+00:00, map_index=-1, run_start_date=2024-04-03 04:20:03.337260+00:00, run_end_date=2024-04-03 04:20:04.261596+00:00, run_duration=0.924336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:20:00.266759+00:00, queued_by_job_id=1, pid=13317 2024-04-03T04:20:05.099590544Z [2024-04-03T04:20:05.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:19:00+00:00, map_index=-1, run_start_date=2024-04-03 04:20:02.975170+00:00, run_end_date=2024-04-03 04:20:04.694741+00:00, run_duration=1.719571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:20:00.266759+00:00, queued_by_job_id=1, pid=13315 2024-04-03T04:20:05.099898680Z [2024-04-03T04:20:05.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26df0566-8125-40e3-aaa3-85d5ffb18188 2024-04-03T04:20:06.248032363Z [2024-04-03T04:20:06.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:20:06.248746158Z [2024-04-03T04:20:06.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:19:00+00:00, run_id=scheduled__2024-04-03T04:19:00+00:00, run_start_date=2024-04-03 04:20:00.205329+00:00, run_end_date=2024-04-03 04:20:06.248079+00:00, run_duration=6.04275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:19:00+00:00, data_interval_end=2024-04-03 04:20:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:20:06.267382124Z [2024-04-03T04:20:06.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:20:00+00:00, run_after=2024-04-03T04:21:00+00:00 2024-04-03T04:20:06.324015389Z [2024-04-03T04:20:06.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:19:00+00:00 exited with status success for try_number 1 2024-04-03T04:20:06.333959140Z [2024-04-03T04:20:06.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:19:00+00:00, map_index=-1, run_start_date=2024-04-03 04:20:03.199442+00:00, run_end_date=2024-04-03 04:20:05.885286+00:00, run_duration=2.685844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:20:00.266759+00:00, queued_by_job_id=1, pid=13316 2024-04-03T04:20:07.818503693Z [2024-04-03T04:20:07.818+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:20:07.818549603Z 2024-04-03T04:20:07.818713455Z [2024-04-03T04:20:07.818+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:20:07.819311080Z [2024-04-03T04:20:07.819+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:20:07.819327984Z 2024-04-03T04:20:07.821841895Z [2024-04-03T04:20:07.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='collect_metrics', run_id='scheduled__2024-04-03T04:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-03T04:20:07.822080981Z [2024-04-03T04:20:07.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:20:07.864487424Z [2024-04-03T04:20:07.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status queued for try_number 1 2024-04-03T04:20:07.865177842Z [2024-04-03T04:20:07.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.split_metrics run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status success for try_number 1 2024-04-03T04:20:07.872886429Z [2024-04-03T04:20:07.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6b9f3fb-3dd9-49bc-b287-a80089eb8f74 2024-04-03T04:20:07.873340296Z [2024-04-03T04:20:07.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=split_metrics, run_id=scheduled__2024-04-03T04:15:00+00:00, map_index=-1, run_start_date=2024-04-03 04:20:06.643056+00:00, run_end_date=2024-04-03 04:20:06.976758+00:00, run_duration=0.333702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:20:05.032692+00:00, queued_by_job_id=1, pid=13356 2024-04-03T04:20:10.259753003Z [2024-04-03T04:20:10.259+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-03T04:20:10.259794188Z 2024-04-03T04:20:10.259804696Z [2024-04-03T04:20:10.259+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:20:10.260533951Z [2024-04-03T04:20:10.260+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:20:10.260565719Z 2024-04-03T04:20:10.263102842Z [2024-04-03T04:20:10.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='send_prometheus', run_id='scheduled__2024-04-03T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:20:10.263580067Z [2024-04-03T04:20:10.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:20:10.338877502Z [2024-04-03T04:20:10.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status queued for try_number 1 2024-04-03T04:20:10.342963564Z [2024-04-03T04:20:10.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.collect_metrics run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status success for try_number 1 2024-04-03T04:20:10.353525546Z [2024-04-03T04:20:10.353+0000] {scheduler_job.py:635} INFO - Setting external_id for to 680abe50-becf-4236-b321-4776dbf6c9a5 2024-04-03T04:20:10.355567412Z [2024-04-03T04:20:10.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=collect_metrics, run_id=scheduled__2024-04-03T04:15:00+00:00, map_index=0, run_start_date=2024-04-03 04:20:09.478103+00:00, run_end_date=2024-04-03 04:20:09.770162+00:00, run_duration=0.292059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:20:07.819659+00:00, queued_by_job_id=1, pid=13368 2024-04-03T04:20:12.613797657Z [2024-04-03T04:20:12.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:20:12.614463964Z [2024-04-03T04:20:12.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:15:00+00:00, run_id=scheduled__2024-04-03T04:15:00+00:00, run_start_date=2024-04-03 04:20:00.201618+00:00, run_end_date=2024-04-03 04:20:12.613834+00:00, run_duration=12.412216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:15:00+00:00, data_interval_end=2024-04-03 04:20:00+00:00, dag_hash=2d09d60a9ab60d4ea8e7961e7ee686ef 2024-04-03T04:20:12.626648414Z [2024-04-03T04:20:12.626+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:20:00+00:00, run_after=2024-04-03T04:25:00+00:00 2024-04-03T04:20:12.674486790Z [2024-04-03T04:20:12.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.send_prometheus run_id=scheduled__2024-04-03T04:15:00+00:00 exited with status success for try_number 1 2024-04-03T04:20:12.685694766Z [2024-04-03T04:20:12.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=send_prometheus, run_id=scheduled__2024-04-03T04:15:00+00:00, map_index=-1, run_start_date=2024-04-03 04:20:12.095324+00:00, run_end_date=2024-04-03 04:20:12.415017+00:00, run_duration=0.319693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:20:10.260932+00:00, queued_by_job_id=1, pid=13380 2024-04-03T04:21:00.522813089Z [2024-04-03T04:21:00.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:21:00+00:00, run_after=2024-04-03T04:22:00+00:00 2024-04-03T04:21:00.530482704Z [2024-04-03T04:21:00.530+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:21:00.586322780Z [2024-04-03T04:21:00.585+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:21:00.586348210Z 2024-04-03T04:21:00.586352012Z 2024-04-03T04:21:00.586541474Z [2024-04-03T04:21:00.586+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:21:00.586698288Z [2024-04-03T04:21:00.586+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:21:00.587240282Z [2024-04-03T04:21:00.587+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:21:00.587251182Z 2024-04-03T04:21:00.587254836Z 2024-04-03T04:21:00.590279265Z [2024-04-03T04:21:00.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:21:00.590421662Z [2024-04-03T04:21:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:21:00.590755462Z [2024-04-03T04:21:00.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:21:00.590888732Z [2024-04-03T04:21:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:21:00.905605185Z [2024-04-03T04:21:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:20:00+00:00 exited with status queued for try_number 1 2024-04-03T04:21:00.906661522Z [2024-04-03T04:21:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:20:00+00:00 exited with status queued for try_number 1 2024-04-03T04:21:00.918612065Z [2024-04-03T04:21:00.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to 956cc218-0bde-4eb4-8399-88648a7afcb2 2024-04-03T04:21:00.918782232Z [2024-04-03T04:21:00.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f4adf3a-e92f-405d-bd6a-45ba91f2643d 2024-04-03T04:21:05.839057181Z [2024-04-03T04:21:05.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:21:05.839234197Z [2024-04-03T04:21:05.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:20:00+00:00, run_id=scheduled__2024-04-03T04:20:00+00:00, run_start_date=2024-04-03 04:21:00.541114+00:00, run_end_date=2024-04-03 04:21:05.838875+00:00, run_duration=5.297761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:20:00+00:00, data_interval_end=2024-04-03 04:21:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:21:05.848811532Z [2024-04-03T04:21:05.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:21:00+00:00, run_after=2024-04-03T04:22:00+00:00 2024-04-03T04:21:05.891152091Z [2024-04-03T04:21:05.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:20:00+00:00 exited with status success for try_number 1 2024-04-03T04:21:05.897842110Z [2024-04-03T04:21:05.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:20:00+00:00, map_index=-1, run_start_date=2024-04-03 04:21:03.226766+00:00, run_end_date=2024-04-03 04:21:05.218997+00:00, run_duration=1.992231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:21:00.587809+00:00, queued_by_job_id=1, pid=13417 2024-04-03T04:21:06.944404457Z [2024-04-03T04:21:06.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:21:06.944500846Z [2024-04-03T04:21:06.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:20:00+00:00, run_id=scheduled__2024-04-03T04:20:00+00:00, run_start_date=2024-04-03 04:21:00.542510+00:00, run_end_date=2024-04-03 04:21:06.944254+00:00, run_duration=6.401744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:20:00+00:00, data_interval_end=2024-04-03 04:21:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:21:06.955516594Z [2024-04-03T04:21:06.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:21:00+00:00, run_after=2024-04-03T04:22:00+00:00 2024-04-03T04:21:07.015197658Z [2024-04-03T04:21:07.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:20:00+00:00 exited with status success for try_number 1 2024-04-03T04:21:07.021581210Z [2024-04-03T04:21:07.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:20:00+00:00, map_index=-1, run_start_date=2024-04-03 04:21:03.191389+00:00, run_end_date=2024-04-03 04:21:05.986889+00:00, run_duration=2.7955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:21:00.587809+00:00, queued_by_job_id=1, pid=13416 2024-04-03T04:21:36.756811030Z [2024-04-03T04:21:36.756+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-03T04:22:00.856026030Z [2024-04-03T04:22:00.855+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:22:00.863681170Z [2024-04-03T04:22:00.863+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:22:00.876426942Z [2024-04-03T04:22:00.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:22:00+00:00, run_after=2024-04-03T04:23:00+00:00 2024-04-03T04:22:00.953305205Z [2024-04-03T04:22:00.952+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:22:00.953328677Z 2024-04-03T04:22:00.953333060Z 2024-04-03T04:22:00.953336404Z 2024-04-03T04:22:00.953570029Z [2024-04-03T04:22:00.953+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:22:00.953744725Z [2024-04-03T04:22:00.953+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:22:00.953862192Z [2024-04-03T04:22:00.953+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:22:00.954667163Z [2024-04-03T04:22:00.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:22:00.954689856Z 2024-04-03T04:22:00.954694027Z 2024-04-03T04:22:00.954697150Z 2024-04-03T04:22:00.958110099Z [2024-04-03T04:22:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:22:00.958235584Z [2024-04-03T04:22:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:22:00.958649525Z [2024-04-03T04:22:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:22:00.958869497Z [2024-04-03T04:22:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:22:00.959165209Z [2024-04-03T04:22:00.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:22:00.959343744Z [2024-04-03T04:22:00.959+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:22:01.319244176Z [2024-04-03T04:22:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:20:00+00:00 exited with status queued for try_number 1 2024-04-03T04:22:01.320228291Z [2024-04-03T04:22:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:21:00+00:00 exited with status queued for try_number 1 2024-04-03T04:22:01.322913290Z [2024-04-03T04:22:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:21:00+00:00 exited with status queued for try_number 1 2024-04-03T04:22:01.348055424Z [2024-04-03T04:22:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bfcba1d-7b50-4817-b360-6b91895df3d9 2024-04-03T04:22:01.348480459Z [2024-04-03T04:22:01.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcc79814-6d85-48c8-a213-d0e758f68ad4 2024-04-03T04:22:01.348716422Z [2024-04-03T04:22:01.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ce4b27e-ca6c-410e-ab19-098a5bc51416 2024-04-03T04:22:02.580341429Z [2024-04-03T04:22:02.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:22:02.580748180Z [2024-04-03T04:22:02.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:20:00+00:00, run_id=scheduled__2024-04-03T04:20:00+00:00, run_start_date=2024-04-03 04:22:00.889313+00:00, run_end_date=2024-04-03 04:22:02.580235+00:00, run_duration=1.690922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:20:00+00:00, data_interval_end=2024-04-03 04:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:22:02.589767819Z [2024-04-03T04:22:02.589+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:22:00+00:00, run_after=2024-04-03T04:24:00+00:00 2024-04-03T04:22:02.641242064Z [2024-04-03T04:22:02.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:20:00+00:00 exited with status success for try_number 1 2024-04-03T04:22:02.650480869Z [2024-04-03T04:22:02.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:20:00+00:00, map_index=-1, run_start_date=2024-04-03 04:22:02.006202+00:00, run_end_date=2024-04-03 04:22:02.346632+00:00, run_duration=0.34043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:22:00.955338+00:00, queued_by_job_id=1, pid=13453 2024-04-03T04:22:05.555662445Z [2024-04-03T04:22:05.555+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:22:05.555909498Z [2024-04-03T04:22:05.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:21:00+00:00, run_id=scheduled__2024-04-03T04:21:00+00:00, run_start_date=2024-04-03 04:22:00.891101+00:00, run_end_date=2024-04-03 04:22:05.555576+00:00, run_duration=4.664475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:21:00+00:00, data_interval_end=2024-04-03 04:22:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:22:05.567888793Z [2024-04-03T04:22:05.567+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:22:00+00:00, run_after=2024-04-03T04:23:00+00:00 2024-04-03T04:22:05.604182524Z [2024-04-03T04:22:05.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:21:00+00:00 exited with status success for try_number 1 2024-04-03T04:22:05.612105115Z [2024-04-03T04:22:05.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:21:00+00:00, map_index=-1, run_start_date=2024-04-03 04:22:02.922914+00:00, run_end_date=2024-04-03 04:22:04.746363+00:00, run_duration=1.823449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:22:00.955338+00:00, queued_by_job_id=1, pid=13483 2024-04-03T04:22:06.698699453Z [2024-04-03T04:22:06.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:22:06.699216876Z [2024-04-03T04:22:06.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:21:00+00:00, run_id=scheduled__2024-04-03T04:21:00+00:00, run_start_date=2024-04-03 04:22:00.892254+00:00, run_end_date=2024-04-03 04:22:06.698712+00:00, run_duration=5.806458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:21:00+00:00, data_interval_end=2024-04-03 04:22:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:22:06.714098678Z [2024-04-03T04:22:06.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:22:00+00:00, run_after=2024-04-03T04:23:00+00:00 2024-04-03T04:22:06.749777647Z [2024-04-03T04:22:06.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:21:00+00:00 exited with status success for try_number 1 2024-04-03T04:22:06.755374861Z [2024-04-03T04:22:06.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:21:00+00:00, map_index=-1, run_start_date=2024-04-03 04:22:03.098251+00:00, run_end_date=2024-04-03 04:22:06.089365+00:00, run_duration=2.991114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:22:00.955338+00:00, queued_by_job_id=1, pid=13484 2024-04-03T04:23:00.186782327Z [2024-04-03T04:23:00.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:23:00+00:00, run_after=2024-04-03T04:24:00+00:00 2024-04-03T04:23:00.191414920Z [2024-04-03T04:23:00.191+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:23:00.249658724Z [2024-04-03T04:23:00.249+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-03T04:23:00.249688007Z 2024-04-03T04:23:00.249691987Z 2024-04-03T04:23:00.249827757Z [2024-04-03T04:23:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:23:00.249899819Z [2024-04-03T04:23:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:23:00.250406259Z [2024-04-03T04:23:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:23:00.250417317Z 2024-04-03T04:23:00.250421193Z 2024-04-03T04:23:00.254478044Z [2024-04-03T04:23:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:23:00.254585176Z [2024-04-03T04:23:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:23:00.254817567Z [2024-04-03T04:23:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:23:00.254895026Z [2024-04-03T04:23:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:23:00.515636124Z [2024-04-03T04:23:00.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:22:00+00:00 exited with status queued for try_number 1 2024-04-03T04:23:00.515723602Z [2024-04-03T04:23:00.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:22:00+00:00 exited with status queued for try_number 1 2024-04-03T04:23:00.531762647Z [2024-04-03T04:23:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6752016-3692-4aef-842b-c39318aab663 2024-04-03T04:23:00.531850101Z [2024-04-03T04:23:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4502f5eb-23b8-41d9-9469-0d6bfab686a0 2024-04-03T04:23:03.974555973Z [2024-04-03T04:23:03.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:23:03.975142449Z [2024-04-03T04:23:03.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:22:00+00:00, run_id=scheduled__2024-04-03T04:22:00+00:00, run_start_date=2024-04-03 04:23:00.202826+00:00, run_end_date=2024-04-03 04:23:03.974735+00:00, run_duration=3.771909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:22:00+00:00, data_interval_end=2024-04-03 04:23:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:23:03.985955197Z [2024-04-03T04:23:03.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:23:00+00:00, run_after=2024-04-03T04:24:00+00:00 2024-04-03T04:23:05.076601097Z [2024-04-03T04:23:05.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:23:05.077330349Z [2024-04-03T04:23:05.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:22:00+00:00, run_id=scheduled__2024-04-03T04:22:00+00:00, run_start_date=2024-04-03 04:23:00.204810+00:00, run_end_date=2024-04-03 04:23:05.076427+00:00, run_duration=4.871617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:22:00+00:00, data_interval_end=2024-04-03 04:23:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:23:05.092840297Z [2024-04-03T04:23:05.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:23:00+00:00, run_after=2024-04-03T04:24:00+00:00 2024-04-03T04:23:05.133018971Z [2024-04-03T04:23:05.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:22:00+00:00 exited with status success for try_number 1 2024-04-03T04:23:05.133408840Z [2024-04-03T04:23:05.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:22:00+00:00 exited with status success for try_number 1 2024-04-03T04:23:05.144984382Z [2024-04-03T04:23:05.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:22:00+00:00, map_index=-1, run_start_date=2024-04-03 04:23:02.332723+00:00, run_end_date=2024-04-03 04:23:03.918294+00:00, run_duration=1.585571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:23:00.252237+00:00, queued_by_job_id=1, pid=13538 2024-04-03T04:23:05.145662503Z [2024-04-03T04:23:05.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:22:00+00:00, map_index=-1, run_start_date=2024-04-03 04:23:02.563138+00:00, run_end_date=2024-04-03 04:23:04.926192+00:00, run_duration=2.363054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:23:00.252237+00:00, queued_by_job_id=1, pid=13539 2024-04-03T04:24:00.473032811Z [2024-04-03T04:24:00.472+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:24:00.484934316Z [2024-04-03T04:24:00.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:24:00+00:00, run_after=2024-04-03T04:25:00+00:00 2024-04-03T04:24:00.491077123Z [2024-04-03T04:24:00.490+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-03T04:24:00.554357817Z [2024-04-03T04:24:00.554+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-03T04:24:00.554393951Z 2024-04-03T04:24:00.554398930Z 2024-04-03T04:24:00.554402419Z 2024-04-03T04:24:00.554516592Z [2024-04-03T04:24:00.554+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-03T04:24:00.554705259Z [2024-04-03T04:24:00.554+0000] {scheduler_job.py:425} INFO - DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:24:00.554843255Z [2024-04-03T04:24:00.554+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 has 0/16 running and queued tasks 2024-04-03T04:24:00.555380486Z [2024-04-03T04:24:00.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-03T04:24:00.555391086Z 2024-04-03T04:24:00.555394662Z 2024-04-03T04:24:00.555397688Z 2024-04-03T04:24:00.560973329Z [2024-04-03T04:24:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-03T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:24:00.561234966Z [2024-04-03T04:24:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:24:00.561678519Z [2024-04-03T04:24:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:24:00.561812690Z [2024-04-03T04:24:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:24:00.562050504Z [2024-04-03T04:24:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-03T04:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-03T04:24:00.562194258Z [2024-04-03T04:24:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:24:01.052557730Z [2024-04-03T04:24:01.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:22:00+00:00 exited with status queued for try_number 1 2024-04-03T04:24:01.052649786Z [2024-04-03T04:24:01.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:23:00+00:00 exited with status queued for try_number 1 2024-04-03T04:24:01.052655360Z [2024-04-03T04:24:01.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:23:00+00:00 exited with status queued for try_number 1 2024-04-03T04:24:01.065605823Z [2024-04-03T04:24:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e741ca4-2132-430b-bf74-cf51bf33db3e 2024-04-03T04:24:01.065720209Z [2024-04-03T04:24:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to cadd7f61-0104-419f-8b43-204946804e57 2024-04-03T04:24:01.065760259Z [2024-04-03T04:24:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb7deeb0-54ee-46ac-a7be-0616ac45f639 2024-04-03T04:24:02.448652370Z [2024-04-03T04:24:02.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:24:02.449273619Z [2024-04-03T04:24:02.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-03 04:22:00+00:00, run_id=scheduled__2024-04-03T04:22:00+00:00, run_start_date=2024-04-03 04:24:00.500034+00:00, run_end_date=2024-04-03 04:24:02.448925+00:00, run_duration=1.948891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:22:00+00:00, data_interval_end=2024-04-03 04:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-03T04:24:02.456445612Z [2024-04-03T04:24:02.456+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-03T04:24:00+00:00, run_after=2024-04-03T04:26:00+00:00 2024-04-03T04:24:02.517828474Z [2024-04-03T04:24:02.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-03T04:22:00+00:00 exited with status success for try_number 1 2024-04-03T04:24:02.524392718Z [2024-04-03T04:24:02.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-03T04:22:00+00:00, map_index=-1, run_start_date=2024-04-03 04:24:01.672771+00:00, run_end_date=2024-04-03 04:24:02.049909+00:00, run_duration=0.377138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:24:00.556035+00:00, queued_by_job_id=1, pid=13575 2024-04-03T04:24:04.682814371Z [2024-04-03T04:24:04.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:24:04.683081307Z [2024-04-03T04:24:04.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:23:00+00:00, run_id=scheduled__2024-04-03T04:23:00+00:00, run_start_date=2024-04-03 04:24:00.501152+00:00, run_end_date=2024-04-03 04:24:04.682714+00:00, run_duration=4.181562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:23:00+00:00, data_interval_end=2024-04-03 04:24:00+00:00, dag_hash=8ea1873bd96b0d1cdd5bcbfdc275b09d 2024-04-03T04:24:04.691792434Z [2024-04-03T04:24:04.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:24:00+00:00, run_after=2024-04-03T04:25:00+00:00 2024-04-03T04:24:05.770136945Z [2024-04-03T04:24:05.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-03T04:24:05.770362390Z [2024-04-03T04:24:05.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, execution_date=2024-04-03 04:23:00+00:00, run_id=scheduled__2024-04-03T04:23:00+00:00, run_start_date=2024-04-03 04:24:00.502105+00:00, run_end_date=2024-04-03 04:24:05.770039+00:00, run_duration=5.267934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-03 04:23:00+00:00, data_interval_end=2024-04-03 04:24:00+00:00, dag_hash=491a18908d32d314c84eb04b0c65b345 2024-04-03T04:24:05.780485013Z [2024-04-03T04:24:05.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 to 2024-04-03T04:24:00+00:00, run_after=2024-04-03T04:25:00+00:00 2024-04-03T04:24:05.804832315Z [2024-04-03T04:24:05.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:23:00+00:00 exited with status success for try_number 1 2024-04-03T04:24:05.804961085Z [2024-04-03T04:24:05.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-03T04:23:00+00:00 exited with status success for try_number 1 2024-04-03T04:24:05.810317425Z [2024-04-03T04:24:05.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:23:00+00:00, map_index=-1, run_start_date=2024-04-03 04:24:02.795442+00:00, run_end_date=2024-04-03 04:24:04.599930+00:00, run_duration=1.804488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:24:00.556035+00:00, queued_by_job_id=1, pid=13606 2024-04-03T04:24:05.810562932Z [2024-04-03T04:24:05.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-03T04:23:00+00:00, map_index=-1, run_start_date=2024-04-03 04:24:02.771507+00:00, run_end_date=2024-04-03 04:24:05.232329+00:00, run_duration=2.460822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-03 04:24:00.556035+00:00, queued_by_job_id=1, pid=13605